-- Logs begin at Fri 2022-05-13 21:10:11 UTC, end at Fri 2022-05-13 22:15:18 UTC. -- May 13 21:42:50.681402 dv-cinder-840516-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 21:42:50.689903 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 21:42:50 2022] *** May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: nodename: dv-cinder-840516-1-iscsi May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: machine: x86_64 May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: clock source: unix May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: pcre jit disabled May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: detected number of CPU cores: 4 May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: current working directory: / May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: detected binary path: /usr/bin/uwsgi-core May 13 21:42:50.691913 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: your processes number limit is 47680 May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: your memory page size is 4096 bytes May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: detected max file descriptor number: 2048 May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: lock engine: pthread robust mutexes May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: thunder lock: enabled May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 21:42:50.692536 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 21:42:50.737059 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: Python main interpreter initialized at 0x557b8d9269c0 May 13 21:42:50.737059 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: python threads support enabled May 13 21:42:50.737059 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: your server socket listen backlog is limited to 100 connections May 13 21:42:50.737059 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: your mercy for graceful operations on workers is 90 seconds May 13 21:42:50.737398 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: mapped 403077 bytes (393 KB) for 2 cores May 13 21:42:50.737475 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: *** Operational MODE: preforking *** May 13 21:42:50.737712 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: *** uWSGI is running in multiple interpreter mode *** May 13 21:42:50.737712 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: spawned uWSGI master process (pid: 114145) May 13 21:42:50.737891 dv-cinder-840516-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 21:42:50.739412 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: spawned uWSGI worker 1 (pid: 114146, cores: 1) May 13 21:42:50.739412 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: spawned uWSGI worker 2 (pid: 114147, cores: 1) May 13 21:42:50.739412 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 21:42:51.935238 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 21:42:51.935870 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 21:42:52.660840 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:42:52.660840 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: from cryptography.utils import int_from_bytes May 13 21:42:52.661162 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:42:52.661162 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: from cryptography.utils import int_from_bytes May 13 21:42:52.661445 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:42:52.661445 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: from cryptography.utils import int_from_bytes May 13 21:42:52.661741 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:42:52.661741 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: from cryptography.utils import int_from_bytes May 13 21:42:55.257433 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 21:42:55.258117 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 21:42:55.258215 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 21:42:55.258540 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 21:42:55.258639 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 21:42:55.259026 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 21:42:55.259196 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 21:42:55.259285 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.259380 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 21:42:55.259507 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.259746 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 21:42:55.259840 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.260006 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 21:42:55.260131 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.260396 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.260489 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.260726 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.260825 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261052 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261143 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261366 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261456 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261690 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261792 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.261951 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262044 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262263 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262358 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262583 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840516-1-iscsi {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262676 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.262932 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263072 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263200 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263518 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263654 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263832 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.263963 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840516-1-iscsi {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264134 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264260 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264452 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264589 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264757 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.264889 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.265079 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.265249 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.266481 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.266623 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.266777 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.266918 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267046 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267181 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267309 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267448 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267577 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267707 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267838 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.267965 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268092 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268221 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268353 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268474 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268610 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268731 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268859 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.268989 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269117 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269251 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840516-1-iscsi {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269381 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269508 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269636 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269764 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.269891 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270012 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270138 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840516-1-iscsi {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270262 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270390 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270500 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270619 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270775 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.270911 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271080 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271239 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271556 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271712 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.271892 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272074 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272221 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272396 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272533 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272713 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.272840 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273030 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273164 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273332 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273471 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273642 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273774 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.273948 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274079 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274265 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274405 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274567 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274727 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.274896 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275033 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275153 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275311 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275447 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275622 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275754 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.275932 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276058 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276188 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276356 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276493 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276625 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276794 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.276932 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277118 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277250 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277444 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277582 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277717 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277841 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.277968 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278100 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278250 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278382 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278573 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278735 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.278912 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279038 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279224 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279359 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279529 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279662 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279834 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.279958 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280140 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280276 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280452 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280575 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280758 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.280889 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281064 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281200 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281380 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281512 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281696 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.281818 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282010 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282196 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282321 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282442 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282627 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282788 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.282977 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283119 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283285 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283416 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283600 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283726 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.283920 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284046 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284226 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284358 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284531 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284662 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284860 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.284993 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285120 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285232 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285443 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285576 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285745 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285877 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.285999 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286120 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286279 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286412 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286583 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286771 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.286929 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287056 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287229 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287366 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287564 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287695 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.287873 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288005 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288172 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288327 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288503 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288662 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288792 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.288921 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289042 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289172 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289343 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289476 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289647 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289777 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.289949 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290082 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290252 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290377 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290552 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290675 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.290882 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291020 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291200 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291326 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291506 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291629 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291809 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.291934 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292113 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292240 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292417 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292557 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292720 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.292864 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293038 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293169 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293343 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293466 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293644 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293769 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.293951 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294087 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294254 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294379 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294556 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294691 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.294887 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295012 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295203 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295334 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295508 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295635 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295813 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.295945 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296108 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296232 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296412 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296540 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296726 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.296866 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297037 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297162 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297338 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297463 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297637 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297769 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.297939 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298065 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298240 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298366 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298544 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298669 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298856 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.298987 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299158 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299282 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299458 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299597 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299763 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.299895 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300069 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300195 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300371 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300501 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300671 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300807 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.300972 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.301095 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.301286 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.301412 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.301597 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.301730 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.301909 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.302041 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.302216 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.302342 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.302537 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:42:55.302675 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.302906 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.303033 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.303767 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.303892 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304090 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304219 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304406 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304531 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304724 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.304856 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305049 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305183 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305362 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305496 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305674 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305809 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.305986 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306126 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306307 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306431 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306621 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306851 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.306984 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307105 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307275 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307487 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307623 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307745 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.307899 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308027 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308212 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308532 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308666 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308850 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.308981 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309168 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309293 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309480 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309614 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309800 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.309924 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310135 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310261 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310445 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310578 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310788 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.310914 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311108 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311234 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311422 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311564 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311734 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.311860 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312046 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312180 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312367 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312493 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312697 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.312822 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313009 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313132 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313326 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313450 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313639 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313765 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.313951 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314076 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314260 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314387 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314570 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314695 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.314906 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315032 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315223 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315367 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315540 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315658 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315851 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.315990 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316165 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316300 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316479 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316603 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316791 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.316934 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317238 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317421 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317548 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317725 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.317858 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.318028 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.318153 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.318333 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.318549 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.318674 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.319375 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.319507 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.319627 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.319822 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.319948 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320133 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320268 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320449 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320577 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320760 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.320895 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321088 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321215 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321403 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321527 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321713 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.321839 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322023 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322158 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322452 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322637 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322780 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.322978 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323104 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323281 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323404 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323597 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323722 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.323903 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324027 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324211 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324343 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324517 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324648 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324823 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.324947 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325126 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325252 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325439 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325581 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325747 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.325881 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326056 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326214 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326361 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326498 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326665 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.326849 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327008 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327135 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327323 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327456 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327639 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327765 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.327957 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328115 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328284 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328411 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328602 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328735 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.328917 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329044 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329258 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329384 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329587 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329711 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.329890 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330018 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330198 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330324 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330498 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330623 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330827 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.330975 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331171 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331295 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331424 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331552 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331708 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.331841 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332010 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332136 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332310 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332435 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332610 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332743 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.332910 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333042 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333213 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333344 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333521 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333653 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333822 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.333947 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334123 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334256 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334450 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334581 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334799 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.334927 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335106 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335245 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335524 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335658 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335781 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.335901 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336029 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336151 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336326 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336453 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336661 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336785 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.336975 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337108 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337283 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337411 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337600 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337724 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.337908 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338033 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338219 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338349 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338529 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338652 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338862 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.338999 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339176 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339300 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339479 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339602 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339799 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.339938 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340102 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340237 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340418 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340544 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340720 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.340855 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341030 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341155 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341341 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341472 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341662 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341797 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.341970 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342285 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342416 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342594 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342744 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.342941 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343068 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343248 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343373 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343558 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343686 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.343868 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344000 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344177 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344302 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344487 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344618 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344791 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.344915 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345101 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345235 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345403 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345528 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345719 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.345844 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346024 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346154 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346340 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346467 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346639 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346838 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.346962 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347097 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347413 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347609 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347735 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.347913 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348046 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348223 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348348 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348541 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348674 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348850 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.348985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349157 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349284 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349465 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349598 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349770 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.349908 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350097 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350225 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350403 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350530 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350727 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.350870 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351043 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351169 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351347 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351478 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351648 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351786 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.351959 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352094 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352267 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352392 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352571 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352698 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352873 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.352998 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353181 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353307 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353498 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353623 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353802 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.353925 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354106 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354231 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354419 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354544 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354732 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.354858 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355041 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355184 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355359 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355485 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355665 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.355969 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356108 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356269 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356395 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356571 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356696 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.356884 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357018 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357194 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357320 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357499 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357623 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357805 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.357931 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358118 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358248 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358423 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358556 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358758 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.358887 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359069 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359206 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359375 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359501 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359687 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359811 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.359993 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360123 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360297 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360423 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360603 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360730 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.360911 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361037 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361219 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361353 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361527 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361650 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361841 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.361966 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362143 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362275 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362451 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362578 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362780 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.362921 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363084 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363218 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363391 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363517 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363706 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.363831 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364015 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364270 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364398 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364602 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364728 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.364916 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.365051 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.365233 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.365475 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.366114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.366340 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.366473 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.366661 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.366823 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367009 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367128 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367335 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367460 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367660 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367801 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.367973 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368097 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368280 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368405 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368583 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368721 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.368892 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369028 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369197 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369322 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369498 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369630 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369801 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.369929 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370109 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370242 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370411 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370536 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370720 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.370849 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371037 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371163 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371338 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371464 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371643 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371768 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.371942 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.372077 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.372497 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.372631 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.372797 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.372927 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373109 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373244 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373411 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373543 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373713 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.373838 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374014 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374140 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374443 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374632 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374787 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.374967 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375094 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375275 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375413 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375585 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375710 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.375930 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376055 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376237 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376369 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376535 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376671 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376859 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.376993 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377161 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377462 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377588 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377762 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.377888 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378073 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378200 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378377 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378503 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378676 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.378879 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379011 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379141 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379300 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379426 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379605 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379739 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.379910 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380035 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380208 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380336 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380510 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380644 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380809 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.380936 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.381116 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.381258 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.381978 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382113 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382292 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382420 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382590 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382739 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.382924 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383064 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383229 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383529 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383654 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383833 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.383960 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384133 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384260 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384441 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384568 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384740 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.384877 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385039 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385166 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385340 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385466 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385646 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385774 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.385950 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386075 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386246 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386376 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386548 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386681 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.386882 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387017 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387185 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387323 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387485 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387617 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387791 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.387916 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388097 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388231 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388398 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388530 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388699 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.388823 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389013 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389223 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389348 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389469 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389602 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389771 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.389915 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390049 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390193 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390318 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390493 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390619 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390818 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.390955 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391125 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391251 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391426 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391559 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391726 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.391854 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392025 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392143 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392326 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392451 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392625 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392752 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.392928 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393052 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393231 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393354 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393532 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393666 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393829 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.393964 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394128 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394302 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394433 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394554 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394761 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.394891 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395071 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395203 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395379 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395507 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395701 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.395824 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396016 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396152 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396326 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396459 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396634 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396769 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.396968 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397105 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397269 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397394 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397579 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397704 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.397890 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398017 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398199 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398334 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398499 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398638 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.398942 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399069 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399198 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399448 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399568 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399729 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.399857 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400035 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400159 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400352 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400476 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400663 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400788 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.400960 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401091 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401265 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401392 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401571 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401698 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.401875 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402008 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402179 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402327 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402497 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402621 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402835 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.402977 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403100 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403235 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403392 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403519 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403700 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.403833 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404005 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404141 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404307 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404433 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404609 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404727 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.404913 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405046 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405214 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405333 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405520 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405645 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405825 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.405951 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406126 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406251 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406428 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406553 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406746 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.406873 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407056 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407181 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407357 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407483 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407664 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407790 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.407971 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408096 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408408 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408590 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408717 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.408953 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409077 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409259 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409392 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409571 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409750 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.409880 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410002 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410168 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410311 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410502 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410626 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410845 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.410972 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411163 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411304 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411471 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411597 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411791 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.411915 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412092 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412228 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412411 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412558 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412757 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.412884 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413059 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413185 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413360 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413485 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413660 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413785 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.413979 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414106 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414279 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414412 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414596 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414738 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.414927 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415055 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415252 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415385 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415559 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415686 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.415884 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416012 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416305 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416429 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416612 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416739 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.416915 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417041 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417235 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417359 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417552 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417751 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417875 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.417996 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.418157 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.418285 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.418465 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.418684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.418862 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419000 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419125 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419247 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419414 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419540 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419725 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.419860 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420026 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420160 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420346 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420474 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420664 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420799 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.420973 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421099 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421281 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421608 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421737 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.421934 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422068 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422250 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422383 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422576 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422724 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.422929 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423055 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423235 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423361 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423540 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423667 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423849 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.423977 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424152 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424278 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424457 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424584 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424776 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.424895 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425078 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425213 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425386 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425505 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425693 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425819 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.425998 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426132 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426300 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426427 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426602 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426774 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.426958 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427097 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427262 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427389 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427566 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427690 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.427875 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.428076 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.428721 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.428843 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429023 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429149 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429325 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429453 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429644 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429769 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.429949 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430080 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430250 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430385 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430549 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430676 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.430900 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431025 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431235 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431368 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431519 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431646 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431826 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.431952 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432134 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432262 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432463 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432587 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432772 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.432911 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433092 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433217 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433411 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433534 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433725 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.433860 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434040 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434164 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434360 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434483 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434664 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.434916 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435031 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435159 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435293 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435481 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435607 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435730 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435851 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.435973 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436150 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436276 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436457 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436583 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436758 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.436890 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437060 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437193 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437361 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437488 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437679 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437805 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.437981 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438119 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438302 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438437 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438605 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438763 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.438933 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439058 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439235 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439362 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439536 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439661 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439863 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.439995 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440163 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440467 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440591 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440775 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.440910 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441096 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441221 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441419 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441552 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441722 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.441859 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442040 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442166 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442352 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442478 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442665 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.442836 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.443014 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.443153 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.443477 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.443612 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.443800 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.444421 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.444551 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.444674 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.444795 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.444916 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445046 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445169 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445359 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445493 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445670 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445796 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.445984 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.446111 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.446330 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.446501 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.446650 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.446858 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447000 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447175 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447302 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447488 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447798 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.447933 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448112 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448237 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448429 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448556 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448738 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.448873 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449049 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449176 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449358 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449484 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449668 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449803 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.449977 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450102 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450295 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450428 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450612 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450758 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.450952 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451092 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451278 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451402 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451592 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451721 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.451904 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452031 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452217 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452344 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452551 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452685 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452870 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.452995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453171 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453307 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453483 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453609 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453794 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.453920 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454106 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454233 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454415 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454543 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454747 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.454877 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455056 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455184 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455366 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455492 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455683 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455802 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.455989 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456122 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456434 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456610 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456734 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.456925 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457052 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457238 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457365 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457553 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457755 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.457882 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458004 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458162 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458481 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458615 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.458830 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459031 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459157 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459361 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459507 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459697 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.459824 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460019 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460290 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460430 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460610 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460737 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.460941 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461067 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461264 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461390 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461569 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461703 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461870 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.461996 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462177 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462303 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462482 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462609 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462808 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.462936 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463128 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463266 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463435 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463562 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463738 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.463865 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464040 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464173 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464345 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464485 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464667 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.464873 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465005 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465213 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465333 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465528 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465652 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.465851 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466097 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466230 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466445 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466569 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466839 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.466966 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467100 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467222 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467397 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467521 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467700 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.467833 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468012 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468131 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468324 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468449 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468628 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468762 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.468930 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469056 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469238 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469363 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469546 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469670 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469846 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.469979 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470151 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470274 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470450 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470587 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470785 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.470922 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471092 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471221 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471394 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471528 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471696 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.471820 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472005 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472129 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472308 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472441 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472607 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472740 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.472911 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473033 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473209 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473342 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473515 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473641 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473815 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.473946 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474118 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474259 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474415 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474539 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474737 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.474877 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475067 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475201 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475375 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475500 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475680 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475804 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.475995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476128 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476303 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476427 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476602 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476725 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.476913 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477039 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477219 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477344 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477536 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477667 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477841 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.477968 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478147 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478455 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478592 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478803 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.478930 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.479122 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.479343 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.479469 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.479676 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.479802 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480007 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480140 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480339 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480596 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480746 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.480938 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481043 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481251 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481348 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481557 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481655 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481877 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.481983 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482186 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482494 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482591 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482824 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.482936 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483132 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483230 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483437 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483535 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483743 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.483840 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484050 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484137 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484355 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484444 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484659 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484745 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.484964 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485061 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485269 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485356 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485576 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485675 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485882 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.485982 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.486197 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.486292 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.486507 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.486595 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.486841 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487017 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487152 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487239 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487464 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487551 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487770 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.487859 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488077 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488163 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488388 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488475 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488695 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.488791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489006 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489094 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489327 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489414 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489635 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489732 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.489939 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.490026 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.490255 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.490351 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.490588 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.491193 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.491450 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.491547 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.491763 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.491861 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492115 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492201 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492434 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492521 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492755 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.492856 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493066 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493169 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493387 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493487 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493691 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.493789 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494018 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494105 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494339 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494425 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494661 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.494789 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495004 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495091 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495308 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495395 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495616 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495783 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.495926 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496073 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496243 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496392 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496530 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496666 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496809 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.496956 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.497091 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.497495 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.497637 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.497774 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.497936 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498079 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498225 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498370 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498515 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498651 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.498847 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499013 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499158 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499303 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499446 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499583 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499718 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.499854 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500024 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500169 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500312 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500448 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500615 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500759 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.500922 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501060 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501196 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501331 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501494 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501632 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501776 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.501919 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502057 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502192 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502356 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502499 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502643 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502831 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.502969 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503106 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503289 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503445 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503623 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503765 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.503937 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504080 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504257 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504408 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504567 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504717 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.504871 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505007 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505179 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505331 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505499 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505642 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505819 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.505961 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.506134 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.506884 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507062 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507207 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507352 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507497 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507643 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507786 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.507962 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508111 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508278 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508426 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508599 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508743 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.508915 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509055 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509223 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509381 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509534 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509703 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509849 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.509985 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510121 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510266 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510439 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510582 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510785 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.510930 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511110 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511273 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511420 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511555 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511722 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.511870 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512042 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512192 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512351 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512492 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512660 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512811 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.512956 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513094 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513268 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513412 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513578 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513720 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.513892 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514036 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514204 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514347 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514516 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514663 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514843 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.514989 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515158 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515301 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515475 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515617 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515793 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.515934 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516119 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516282 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516427 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516635 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516776 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.516911 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517047 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517194 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517372 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517521 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517688 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517831 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.517992 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.518134 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.518287 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 21:42:55.518433 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.518663 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.519017 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.519329 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:42:55.519577 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 21:42:55.541453 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_db.sqlalchemy.engines [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.543003 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_db.sqlalchemy.engines [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.604768 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.context [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415e9a87-7af9-4b21-ab24-8ddfa7580a0e(cell1) {{(pid=114146) load_cells /opt/stack/nova/nova/context.py:464}} May 13 21:42:55.606844 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.context [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415e9a87-7af9-4b21-ab24-8ddfa7580a0e(cell1) {{(pid=114147) load_cells /opt/stack/nova/nova/context.py:464}} May 13 21:42:55.609072 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_concurrency.lockutils [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:42:55.610650 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_concurrency.lockutils [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:42:55.611138 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:42:55.611450 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_concurrency.lockutils [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:42:55.612715 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:42:55.613376 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_concurrency.lockutils [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:42:55.613515 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:42:55.615494 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:42:55.625518 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_db.sqlalchemy.engines [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.628982 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_db.sqlalchemy.engines [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.633318 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_db.sqlalchemy.engines [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.636594 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_db.sqlalchemy.engines [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.791360 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG oslo_db.sqlalchemy.engines [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:55.794180 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_db.sqlalchemy.engines [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:42:56.126802 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: WARNING keystonemiddleware.auth_token [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:42:56.127009 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: WARNING keystonemiddleware.auth_token [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:42:56.134613 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: WARNING keystonemiddleware.auth_token [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:42:56.134984 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: WARNING keystonemiddleware.auth_token [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:42:56.477788 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: WARNING keystonemiddleware.auth_token [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:42:56.479985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: WARNING keystonemiddleware.auth_token [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:42:56.483942 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: WARNING keystonemiddleware.auth_token [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:42:56.485987 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: WARNING keystonemiddleware.auth_token [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:42:56.490060 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b8d9269c0 pid: 114146 (default app) May 13 21:42:56.492589 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b8d9269c0 pid: 114147 (default app) May 13 21:42:56.492687 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:42:56.493853 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-3eb781e5-0748-4b6a-8239-3c351f8a1b07 None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001704 May 13 21:42:56.494272 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Fri May 13 21:42:56 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:13.964249 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:13.965788 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 May 13 21:44:13.966603 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:14.380884 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-4193ea86-8d19-4512-bcda-ca3bf0f5f367 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:14.409265 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-4193ea86-8d19-4512-bcda-ca3bf0f5f367 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.436687 May 13 21:44:14.410744 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 2/3] 10.222.0.35 () {60 vars in 1291 bytes} [Fri May 13 21:44:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:16.699323 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:16.700319 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-a9bbdc89-4e43-462b-ac75-07cd83ba0586 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 13 21:44:16.700714 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 2/4] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:44:16.763156 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-887aaff3-3578-4662-ab90-afb6761a9831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:16.781867 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:44:16.781867 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: warnings.warn(msg) May 13 21:44:16.812917 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-887aaff3-3578-4662-ab90-afb6761a9831 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106184 May 13 21:44:16.813482 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 3/5] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 21:44:17.028476 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-ecd7c0fc-f03c-4afd-88f1-e27b6560817f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:17.030989 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:44:17.030989 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:44:17.077549 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-ecd7c0fc-f03c-4afd-88f1-e27b6560817f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.255504 May 13 21:44:17.085270 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 3/6] 10.222.0.35 () {64 vars in 1335 bytes} [Fri May 13 21:44:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:19.358978 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-887aaff3-3578-4662-ab90-afb6761a9831 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:19.360695 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-887aaff3-3578-4662-ab90-afb6761a9831 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 May 13 21:44:19.369893 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 4/7] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:19.475202 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-57f256c1-d3a8-4c4d-9bc3-0850d5b3ea70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "disk": 5}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:19.493260 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:44:19.493260 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:44:19.511420 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-57f256c1-d3a8-4c4d-9bc3-0850d5b3ea70 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143217 May 13 21:44:19.512155 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 4/8] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:19.523781 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-bae2fa71-f02b-49ea-ac4d-b9cdeef880fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:19.525245 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:44:19.525245 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: warnings.warn(msg) May 13 21:44:19.556701 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-bae2fa71-f02b-49ea-ac4d-b9cdeef880fb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036639 May 13 21:44:19.557458 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 5/9] 10.222.0.35 () {64 vars in 1335 bytes} [Fri May 13 21:44:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:21.932752 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-57f256c1-d3a8-4c4d-9bc3-0850d5b3ea70 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:21.934405 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-57f256c1-d3a8-4c4d-9bc3-0850d5b3ea70 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 May 13 21:44:21.935090 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:22.000890 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-751f9d44-7c5a-4011-a4b4-23b6980389f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:22.021507 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-751f9d44-7c5a-4011-a4b4-23b6980389f1 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079354 May 13 21:44:22.022174 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 6/11] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:22.033973 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-fdb8e78a-3d22-4e78-87e1-551abffc9679 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:22.057851 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-fdb8e78a-3d22-4e78-87e1-551abffc9679 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027559 May 13 21:44:22.058531 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 6/12] 10.222.0.35 () {64 vars in 1335 bytes} [Fri May 13 21:44:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:24.350361 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-751f9d44-7c5a-4011-a4b4-23b6980389f1 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:24.351482 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-751f9d44-7c5a-4011-a4b4-23b6980389f1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 May 13 21:44:24.351884 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 7/13] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:24.411162 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-2ad5f63b-c3de-40d0-8066-a961f0430a31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "id": "d3"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:24.428330 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-2ad5f63b-c3de-40d0-8066-a961f0430a31 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070214 May 13 21:44:24.430016 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 7/14] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 21:44:24.441423 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-a9c0b451-dfb2-495f-a5c4-9e30007975cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:24.465004 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-a9c0b451-dfb2-495f-a5c4-9e30007975cb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027749 May 13 21:44:24.465792 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 8/15] 10.222.0.35 () {64 vars in 1335 bytes} [Fri May 13 21:44:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:44:26.729197 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-2ad5f63b-c3de-40d0-8066-a961f0430a31 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:26.730211 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-2ad5f63b-c3de-40d0-8066-a961f0430a31 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 13 21:44:26.730616 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 8/16] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:26.795815 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "vcpus": 4, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:26.813259 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076746 May 13 21:44:26.813807 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 9/17] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:26.825421 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-ce847dbf-1285-4c4f-a41d-0842f2de93f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:26.849239 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-ce847dbf-1285-4c4f-a41d-0842f2de93f3 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027444 May 13 21:44:26.849790 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 9/18] 10.222.0.35 () {64 vars in 1335 bytes} [Fri May 13 21:44:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:44:29.103646 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:29.104656 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 13 21:44:29.105062 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 10/19] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:29.167102 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-1ba17681-1cca-4869-9959-d60f70c74473 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:29.190071 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-1ba17681-1cca-4869-9959-d60f70c74473 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078554 May 13 21:44:29.191240 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 10/20] 10.222.0.35 () {60 vars in 1291 bytes} [Fri May 13 21:44:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:44:31.445693 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:31.446676 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-5ff2fe35-7cd0-4272-b165-78c430e93a5e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 13 21:44:31.447129 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 11/21] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:31.505012 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-49fbba80-4e42-4fdf-becd-aac890b4cf3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:31.525209 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-49fbba80-4e42-4fdf-becd-aac890b4cf3e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072142 May 13 21:44:31.526004 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 11/22] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:31.537929 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2da46427-9c3a-4a00-9274-0ac6f3d2a6af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:31.562042 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-2da46427-9c3a-4a00-9274-0ac6f3d2a6af admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027811 May 13 21:44:31.562794 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 12/23] 10.222.0.35 () {64 vars in 1332 bytes} [Fri May 13 21:44:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:34.416588 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-49fbba80-4e42-4fdf-becd-aac890b4cf3e admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:34.417805 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-49fbba80-4e42-4fdf-becd-aac890b4cf3e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 May 13 21:44:34.418282 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 12/24] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:34.489636 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2e2e5cf0-9022-4873-aa0e-f98c3178b5c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "id": "2", "ram": 2048, "swap": 0}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:34.507592 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-2e2e5cf0-9022-4873-aa0e-f98c3178b5c1 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082093 May 13 21:44:34.508384 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 13/25] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:34.522082 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-0ad9f63e-09e6-49c2-9bca-c5aa8fac10af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:34.544665 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-0ad9f63e-09e6-49c2-9bca-c5aa8fac10af admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026865 May 13 21:44:34.545234 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 13/26] 10.222.0.35 () {64 vars in 1332 bytes} [Fri May 13 21:44:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:36.907721 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2e2e5cf0-9022-4873-aa0e-f98c3178b5c1 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:36.908819 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-2e2e5cf0-9022-4873-aa0e-f98c3178b5c1 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 13 21:44:36.909259 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 14/27] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:36.966364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-a7251215-9fb6-450d-9196-8fb39711fbcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:36.984673 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-a7251215-9fb6-450d-9196-8fb39711fbcd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069908 May 13 21:44:36.985220 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 14/28] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:36.997240 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-4c3269da-1cc1-4388-b167-c53096ad0e88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:37.019952 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-4c3269da-1cc1-4388-b167-c53096ad0e88 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026786 May 13 21:44:37.020511 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 15/29] 10.222.0.35 () {64 vars in 1332 bytes} [Fri May 13 21:44:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:39.274288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-a7251215-9fb6-450d-9196-8fb39711fbcd admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:39.275955 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-a7251215-9fb6-450d-9196-8fb39711fbcd admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 13 21:44:39.276500 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 15/30] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:39.343888 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-212e17bf-839a-40e7-8405-f46e2e6f0bec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "id": "4"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:39.363569 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-212e17bf-839a-40e7-8405-f46e2e6f0bec admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080506 May 13 21:44:39.364134 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 16/31] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 21:44:39.376165 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-7c53cf41-0e3f-438f-adf4-000a67356ea7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:39.400121 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-7c53cf41-0e3f-438f-adf4-000a67356ea7 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027651 May 13 21:44:39.400792 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 16/32] 10.222.0.35 () {64 vars in 1332 bytes} [Fri May 13 21:44:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:44:41.669441 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-212e17bf-839a-40e7-8405-f46e2e6f0bec admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:44:41.671133 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-212e17bf-839a-40e7-8405-f46e2e6f0bec admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 May 13 21:44:41.675000 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 17/33] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:44:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:44:41.734150 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:41.755353 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078075 May 13 21:44:41.756157 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 17/34] 10.222.0.35 () {64 vars in 1282 bytes} [Fri May 13 21:44:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:44:41.767932 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-72a1f317-a84e-4a4a-96b2-d2bddf55c09e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:44:41.791348 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-72a1f317-a84e-4a4a-96b2-d2bddf55c09e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027337 May 13 21:44:41.791941 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 18/35] 10.222.0.35 () {64 vars in 1332 bytes} [Fri May 13 21:44:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:45:05.607665 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:05.608673 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 13 21:45:05.609073 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 18/36] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:05.666824 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-6581a2f1-852d-4bc7-b736-87a14c331630 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:05.685172 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-6581a2f1-852d-4bc7-b736-87a14c331630 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070205 May 13 21:45:05.685717 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 19/37] 10.222.0.35 () {60 vars in 1291 bytes} [Fri May 13 21:45:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:45:06.680335 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:06.681336 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-91b47aa0-dd9b-45eb-8788-3e6ca8110b08 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 13 21:45:06.681732 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 19/38] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:06.876971 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-edb07699-ebae-46e7-a2b7-e5afc5a9e376 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:06.882952 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.wsgi [None req-edb07699-ebae-46e7-a2b7-e5afc5a9e376 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-edb07699-ebae-46e7-a2b7-e5afc5a9e376 admin admin] Request method failure captured: May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept: application/json May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept-Encoding: gzip, deflate May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Connection: keep-alive May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Content-Length: 0 May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Host: 10.222.0.35 May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-Api-Version: compute 2.90 May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-System-Scope: None May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: User-Agent: python-novaclient May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Auth-Token: gAAAAABiftFif-ZQCfm-QMiYa3930uBW_mpgfjh-sDSliaHVeGV8cbxQwI7gCDRsxyoSZlTR5VacnCcf2Zrk6aRvDUXl1WbcE3fkxPasa4kv1LqRk7zTdAtqDfe2pmuRWEyQEKsvgvN1PbkKjs6WBKkQOXfclo05JokgUs3HdsB4-Y59rz9wa_Y May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Id: None May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Name: None May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Identity-Status: Confirmed May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Is-Admin-Project: True May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Id: default May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Name: Default May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Name: admin May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Role: member,admin,reader May 13 21:45:06.886107 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Roles: member,admin,reader May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant: admin May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Name: admin May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User: admin May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Id: default May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Name: Default May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Name: admin May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: method: > May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: exception: Flavor 42 could not be found. May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: action_args: {'id': '42'} May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:06.888103 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:06.889114 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:06.890761 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-edb07699-ebae-46e7-a2b7-e5afc5a9e376 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:06.892199 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-edb07699-ebae-46e7-a2b7-e5afc5a9e376 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061988 May 13 21:45:06.892199 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 20/39] 10.222.0.35 () {60 vars in 1190 bytes} [Fri May 13 21:45:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 21:45:06.898288 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-25da263d-335e-4457-bcf9-e19de952a226 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:06.918365 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-25da263d-335e-4457-bcf9-e19de952a226 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023656 May 13 21:45:06.918939 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 20/40] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:45:06.928772 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-ddbdc6b5-2645-44fc-8b6f-aa37e112e9b8 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:06.949948 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-ddbdc6b5-2645-44fc-8b6f-aa37e112e9b8 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024780 May 13 21:45:06.950476 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 21/41] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:45:06.960181 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-0493c8f5-03f7-4c82-96ca-d0c153fa5820 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:06.965531 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.wsgi [None req-0493c8f5-03f7-4c82-96ca-d0c153fa5820 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-0493c8f5-03f7-4c82-96ca-d0c153fa5820 admin admin] Request method failure captured: May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept: application/json May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept-Encoding: gzip, deflate May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Connection: keep-alive May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Content-Length: 0 May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Host: 10.222.0.35 May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-Api-Version: compute 2.90 May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-System-Scope: None May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: User-Agent: python-novaclient May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Auth-Token: gAAAAABiftFif-ZQCfm-QMiYa3930uBW_mpgfjh-sDSliaHVeGV8cbxQwI7gCDRsxyoSZlTR5VacnCcf2Zrk6aRvDUXl1WbcE3fkxPasa4kv1LqRk7zTdAtqDfe2pmuRWEyQEKsvgvN1PbkKjs6WBKkQOXfclo05JokgUs3HdsB4-Y59rz9wa_Y May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Id: None May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Name: None May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Identity-Status: Confirmed May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Is-Admin-Project: True May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Id: default May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Name: Default May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Name: admin May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Role: member,admin,reader May 13 21:45:06.968791 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Roles: member,admin,reader May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant: admin May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Name: admin May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User: admin May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Id: default May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Name: Default May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Name: admin May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: method: > May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: exception: Flavor 42 could not be found. May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: action_args: {'id': '42'} May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:06.970283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:06.971364 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:06.972554 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-0493c8f5-03f7-4c82-96ca-d0c153fa5820 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:06.973526 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-0493c8f5-03f7-4c82-96ca-d0c153fa5820 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013525 May 13 21:45:06.973526 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 21/42] 10.222.0.35 () {60 vars in 1190 bytes} [Fri May 13 21:45:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 13 21:45:07.854655 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-ddbdc6b5-2645-44fc-8b6f-aa37e112e9b8 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:07.855699 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-ddbdc6b5-2645-44fc-8b6f-aa37e112e9b8 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 13 21:45:07.856097 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 22/43] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:08.042674 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-e78b31e4-27df-4c69-956a-0c8407214192 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:08.047907 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.wsgi [None req-e78b31e4-27df-4c69-956a-0c8407214192 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-e78b31e4-27df-4c69-956a-0c8407214192 admin admin] Request method failure captured: May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept: application/json May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept-Encoding: gzip, deflate May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Connection: keep-alive May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Content-Length: 0 May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Host: 10.222.0.35 May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-Api-Version: compute 2.90 May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-System-Scope: None May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: User-Agent: python-novaclient May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Auth-Token: gAAAAABiftFjIOWALlDE1TkyJqMSnFngv2tT9oTZQ61IPI34P55ys3vRT9yszKze7KWuB4CACVVjGc5o88Y7akpqRTIhO1oyilJ4iVgRm2eiUedVL_zzgmRXuNsj24d_C-BH30nERPGwTf1yQsoNFJHsK4lrOmYhBKxRJMSeTvlzvUzqmYoTuXY May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Id: None May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Name: None May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Identity-Status: Confirmed May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Is-Admin-Project: True May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Id: default May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Name: Default May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Name: admin May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Role: member,admin,reader May 13 21:45:08.049438 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Roles: member,admin,reader May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant: admin May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Name: admin May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User: admin May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Id: default May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Name: Default May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Name: admin May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: method: > May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: exception: Flavor 84 could not be found. May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: action_args: {'id': '84'} May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:08.050985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:08.052014 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:08.053350 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-e78b31e4-27df-4c69-956a-0c8407214192 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:08.054623 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-e78b31e4-27df-4c69-956a-0c8407214192 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059333 May 13 21:45:08.054623 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 22/44] 10.222.0.35 () {60 vars in 1190 bytes} [Fri May 13 21:45:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 21:45:08.060452 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-d2d706b6-0899-4221-802d-554e17cdf85c admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:08.073726 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-d2d706b6-0899-4221-802d-554e17cdf85c admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016771 May 13 21:45:08.074202 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 23/45] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:45:08.084070 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-d02429f0-1caa-4416-a2e9-e25d857107c2 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:08.097954 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-d02429f0-1caa-4416-a2e9-e25d857107c2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018159 May 13 21:45:08.098477 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 23/46] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:45:08.107295 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2c196111-259c-4581-8bff-90a6b99729cc admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:08.112306 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.wsgi [None req-2c196111-259c-4581-8bff-90a6b99729cc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2c196111-259c-4581-8bff-90a6b99729cc admin admin] Request method failure captured: May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept: application/json May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept-Encoding: gzip, deflate May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Connection: keep-alive May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Content-Length: 0 May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Host: 10.222.0.35 May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-Api-Version: compute 2.90 May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-System-Scope: None May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: User-Agent: python-novaclient May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Auth-Token: gAAAAABiftFjIOWALlDE1TkyJqMSnFngv2tT9oTZQ61IPI34P55ys3vRT9yszKze7KWuB4CACVVjGc5o88Y7akpqRTIhO1oyilJ4iVgRm2eiUedVL_zzgmRXuNsj24d_C-BH30nERPGwTf1yQsoNFJHsK4lrOmYhBKxRJMSeTvlzvUzqmYoTuXY May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Id: None May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Name: None May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Identity-Status: Confirmed May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Is-Admin-Project: True May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Id: default May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Name: Default May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Name: admin May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Role: member,admin,reader May 13 21:45:08.113769 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Roles: member,admin,reader May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant: admin May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Name: admin May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User: admin May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Id: default May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Name: Default May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Name: admin May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: method: > May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: exception: Flavor 84 could not be found. May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: action_args: {'id': '84'} May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:08.115353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:08.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:08.117327 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-2c196111-259c-4581-8bff-90a6b99729cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:08.118353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-2c196111-259c-4581-8bff-90a6b99729cc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011293 May 13 21:45:08.118353 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 24/47] 10.222.0.35 () {60 vars in 1190 bytes} [Fri May 13 21:45:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 13 21:45:08.987969 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-d02429f0-1caa-4416-a2e9-e25d857107c2 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:08.988975 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-d02429f0-1caa-4416-a2e9-e25d857107c2 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 May 13 21:45:08.989497 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 24/48] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:09.182809 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-8783dc04-769f-4eed-85d7-53e1458a6e98 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:09.188365 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.wsgi [None req-8783dc04-769f-4eed-85d7-53e1458a6e98 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-8783dc04-769f-4eed-85d7-53e1458a6e98 admin admin] Request method failure captured: May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept: application/json May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Accept-Encoding: gzip, deflate May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Connection: keep-alive May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Content-Length: 0 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Host: 10.222.0.35 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-Api-Version: compute 2.90 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Openstack-System-Scope: None May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: User-Agent: python-novaclient May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Auth-Token: gAAAAABiftFkpLfBk2dIPmFAjiNZEfCOmjvssjgQ1bA3xT7oAhMD2_H82M6tvUP20Pq2PWRoksvBBICKqB1ExrSQsvMojD6Cy3LLQyYO6GfNAJ6tXU0poVhkfirJ7nPBM675TP4JhIrdUOvPszPKjpTC34EqElHPMLC5oABAFuHFhHp3eTcjRV0 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Id: None May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Domain-Name: None May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Identity-Status: Confirmed May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Is-Admin-Project: True May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Id: default May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Domain-Name: Default May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Project-Name: admin May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Role: member,admin,reader May 13 21:45:09.189902 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Roles: member,admin,reader May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant: admin May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-Tenant-Name: admin May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User: admin May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Id: default May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Domain-Name: Default May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: X-User-Name: admin May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: method: > May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: exception: Flavor 451 could not be found. May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: action_args: {'id': '451'} May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:09.191405 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:09.192232 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: ERROR nova.api.openstack.wsgi May 13 21:45:09.193315 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-8783dc04-769f-4eed-85d7-53e1458a6e98 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:09.194291 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-8783dc04-769f-4eed-85d7-53e1458a6e98 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059637 May 13 21:45:09.194291 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 25/49] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:45:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 21:45:09.201029 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-8ad361c6-7f42-4c27-9c61-d7b8695e0e69 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:09.218057 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-8ad361c6-7f42-4c27-9c61-d7b8695e0e69 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020463 May 13 21:45:09.218579 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 25/50] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:45:09.228449 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:09.242390 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017407 May 13 21:45:09.242940 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 26/51] 10.222.0.35 () {60 vars in 1210 bytes} [Fri May 13 21:45:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:45:09.252181 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-96d4a931-2c35-4a17-ac6d-90f07a2d60ce admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:09.257430 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.wsgi [None req-96d4a931-2c35-4a17-ac6d-90f07a2d60ce admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-96d4a931-2c35-4a17-ac6d-90f07a2d60ce admin admin] Request method failure captured: May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept: application/json May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Accept-Encoding: gzip, deflate May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Connection: keep-alive May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Content-Length: 0 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Host: 10.222.0.35 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-Api-Version: compute 2.90 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Openstack-System-Scope: None May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: User-Agent: python-novaclient May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Auth-Token: gAAAAABiftFkpLfBk2dIPmFAjiNZEfCOmjvssjgQ1bA3xT7oAhMD2_H82M6tvUP20Pq2PWRoksvBBICKqB1ExrSQsvMojD6Cy3LLQyYO6GfNAJ6tXU0poVhkfirJ7nPBM675TP4JhIrdUOvPszPKjpTC34EqElHPMLC5oABAFuHFhHp3eTcjRV0 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Id: None May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Domain-Name: None May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Identity-Status: Confirmed May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Is-Admin-Project: True May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Openstack-Nova-Api-Version: 2.90 May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Id: default May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Domain-Name: Default May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Project-Name: admin May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Role: member,admin,reader May 13 21:45:09.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Roles: member,admin,reader May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/44b04a795b974ef6b1191a457380d73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_44b04a795b974ef6b1191a457380d73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/44b04a795b974ef6b1191a457380d73c"}]}] May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant: admin May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Id: 44b04a795b974ef6b1191a457380d73c May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-Tenant-Name: admin May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User: admin May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Id: default May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Domain-Name: Default May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Id: 3b8d43206c7f4426b0be3e6d78690460 May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: X-User-Name: admin May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: method: > May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: exception: Flavor 451 could not be found. May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: action_args: {'id': '451'} May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:45:09.260508 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:09.261684 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: ERROR nova.api.openstack.wsgi May 13 21:45:09.263107 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-96d4a931-2c35-4a17-ac6d-90f07a2d60ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:45:09.264349 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-96d4a931-2c35-4a17-ac6d-90f07a2d60ce admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011631 May 13 21:45:09.264349 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 26/52] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:45:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 21:45:10.140673 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:10.141696 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 21:45:10.142091 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 27/53] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:10.331717 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-4b0332b1-23f4-4165-8918-9bf196de4403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:45:10.349359 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-4b0332b1-23f4-4165-8918-9bf196de4403 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067770 May 13 21:45:10.349898 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 27/54] 10.222.0.35 () {64 vars in 1235 bytes} [Fri May 13 21:45:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:45:11.227581 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:11.228622 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 21:45:11.229020 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 28/55] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:11.415170 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-a80dfb90-91b3-4f29-9883-c21e056ee51c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:45:11.431470 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-a80dfb90-91b3-4f29-9883-c21e056ee51c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066966 May 13 21:45:11.432001 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 28/56] 10.222.0.35 () {64 vars in 1235 bytes} [Fri May 13 21:45:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:45:12.320718 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:12.321728 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 13 21:45:12.322128 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 29/57] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:12.508595 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-14b990bc-a0da-4645-9037-a53a74ea7d2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:45:12.525259 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-14b990bc-a0da-4645-9037-a53a74ea7d2d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067204 May 13 21:45:12.525789 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 29/58] 10.222.0.35 () {64 vars in 1235 bytes} [Fri May 13 21:45:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:45:13.412170 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:13.413176 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 13 21:45:13.413579 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 30/59] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:13.599428 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-907629a4-f117-4a3d-b77d-50d7e87926aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:45:13.616808 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-907629a4-f117-4a3d-b77d-50d7e87926aa admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068465 May 13 21:45:13.617381 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 30/60] 10.222.0.35 () {64 vars in 1235 bytes} [Fri May 13 21:45:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:45:14.506397 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:14.507471 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 13 21:45:14.507874 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 31/61] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:45:14.695824 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-28f68476-b2a4-477a-aa4a-f91f73458f29 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:45:14.714848 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-28f68476-b2a4-477a-aa4a-f91f73458f29 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070103 May 13 21:45:14.715434 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 31/62] 10.222.0.35 () {60 vars in 1202 bytes} [Fri May 13 21:45:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:46:16.446391 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.447634 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-84246e21-9a0b-449a-8610-47b52fae7739 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 May 13 21:46:16.448035 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 32/63] 10.222.0.35 () {54 vars in 930 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:46:16.509165 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-82ba27ef-f919-4297-b9d9-7d8e6fcce02a admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.527739 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-82ba27ef-f919-4297-b9d9-7d8e6fcce02a admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073291 May 13 21:46:16.528272 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 32/64] 10.222.0.35 () {60 vars in 1291 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:46:16.554071 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-7df8eb59-c258-4cc5-9435-8495b5c88de3 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.562832 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-7df8eb59-c258-4cc5-9435-8495b5c88de3 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013010 May 13 21:46:16.563352 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 33/65] 10.222.0.35 () {60 vars in 1282 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:46:16.574909 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-e5f8c7b6-173d-4a42-b326-7cc9b674f288 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.582204 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-e5f8c7b6-173d-4a42-b326-7cc9b674f288 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010939 May 13 21:46:16.582727 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 33/66] 10.222.0.35 () {60 vars in 1285 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:46:16.593928 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.602752 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012226 May 13 21:46:16.603264 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 34/67] 10.222.0.35 () {60 vars in 1285 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:46:16.614585 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-fcf0b7b1-3cb0-493c-a5c0-9ff828198021 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:46:16.622134 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-fcf0b7b1-3cb0-493c-a5c0-9ff828198021 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011625 May 13 21:46:16.622651 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 34/68] 10.222.0.35 () {60 vars in 1282 bytes} [Fri May 13 21:46:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:49:37.438877 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:37.439877 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 May 13 21:49:37.440267 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 35/69] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:49:37.702673 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:37.703895 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:49:37.703895 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:49:37.705087 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:37.705516 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:37.706330 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:37.706776 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:37.740279 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-ce06acb5-9584-4cb0-94b7-e6327223f984 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148037 May 13 21:49:37.740842 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 35/70] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:49:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:49:38.636821 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:38.639153 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 May 13 21:49:38.639153 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 36/71] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:49:38.829261 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:38.830425 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:49:38.830425 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:49:38.831667 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:38.832103 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:38.832887 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:38.833308 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:38.852451 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-5b7512c5-5e4e-44d5-99c6-86c83ed25ebd admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075352 May 13 21:49:38.852985 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 36/72] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:49:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:49:50.155741 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:50.157367 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 13 21:49:50.157765 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 37/73] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:49:50.350357 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:50.351555 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:49:50.351555 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:49:50.352742 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:50.353188 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:50.353977 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:50.354436 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:50.379967 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-2b9e2873-5170-43f1-8573-fca794f56992 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083972 May 13 21:49:50.380507 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 37/74] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:49:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:49:51.271245 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: DEBUG nova.api.openstack.wsgi [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] Calling method '>' {{(pid=114146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:51.272259 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: INFO nova.api.openstack.requestlog [None req-b117cb4d-513c-42fd-8900-11fe170c5a58 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 13 21:49:51.272665 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: [pid: 114146|app: 0|req: 38/75] 10.222.0.35 () {56 vars in 1074 bytes} [Fri May 13 21:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:49:51.466084 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG nova.api.openstack.wsgi [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] Calling method '>' {{(pid=114147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:49:51.467329 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 21:49:51.467329 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: warnings.warn(msg) May 13 21:49:51.468531 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:51.468974 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:51.469805 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:49:51.470283 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: DEBUG oslo_concurrency.lockutils [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:49:51.491501 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: INFO nova.api.openstack.requestlog [None req-2dfb186f-3bca-4986-be4e-db79f37cbc50 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076870 May 13 21:49:51.492037 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: [pid: 114147|app: 0|req: 38/76] 10.222.0.35 () {60 vars in 1193 bytes} [Fri May 13 21:49:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:50:48.165955 dv-cinder-840516-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 21:50:48.166518 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: Fri May 13 21:50:48 2022 - graceful shutdown triggered... May 13 21:50:48.167072 dv-cinder-840516-1-iscsi devstack@n-api.service[114146]: Gracefully killing worker 1 (pid: 114146)... May 13 21:50:48.167446 dv-cinder-840516-1-iscsi devstack@n-api.service[114147]: Gracefully killing worker 2 (pid: 114147)... May 13 21:50:49.167408 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: worker 1 buried after 1 seconds May 13 21:50:49.167827 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: worker 2 buried after 1 seconds May 13 21:50:49.167827 dv-cinder-840516-1-iscsi devstack@n-api.service[114145]: goodbye to uWSGI. May 13 21:50:49.168972 dv-cinder-840516-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 21:50:49.169543 dv-cinder-840516-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 21:50:49.172279 dv-cinder-840516-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 21:50:49.188365 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 21:50:49.216192 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 21:50:49 2022] *** May 13 21:50:49.216445 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 21:50:49.216651 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 21:50:49.216833 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: nodename: dv-cinder-840516-1-iscsi May 13 21:50:49.216999 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: machine: x86_64 May 13 21:50:49.217164 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: clock source: unix May 13 21:50:49.217333 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: pcre jit disabled May 13 21:50:49.217493 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: detected number of CPU cores: 4 May 13 21:50:49.217670 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: current working directory: / May 13 21:50:49.217831 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: detected binary path: /usr/bin/uwsgi-core May 13 21:50:49.218007 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: your processes number limit is 47680 May 13 21:50:49.218170 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: your memory page size is 4096 bytes May 13 21:50:49.218333 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: detected max file descriptor number: 2048 May 13 21:50:49.218501 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: lock engine: pthread robust mutexes May 13 21:50:49.218889 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: thunder lock: enabled May 13 21:50:49.219273 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 21:50:49.219524 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 21:50:49.265621 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: Python main interpreter initialized at 0x5643f59e19c0 May 13 21:50:49.265621 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: python threads support enabled May 13 21:50:49.265621 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: your server socket listen backlog is limited to 100 connections May 13 21:50:49.265621 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: your mercy for graceful operations on workers is 90 seconds May 13 21:50:49.266065 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: mapped 403077 bytes (393 KB) for 2 cores May 13 21:50:49.266065 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: *** Operational MODE: preforking *** May 13 21:50:49.266300 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: *** uWSGI is running in multiple interpreter mode *** May 13 21:50:49.266300 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: spawned uWSGI master process (pid: 128468) May 13 21:50:49.266506 dv-cinder-840516-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 21:50:49.267625 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: spawned uWSGI worker 1 (pid: 128488, cores: 1) May 13 21:50:49.267625 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: spawned uWSGI worker 2 (pid: 128489, cores: 1) May 13 21:50:49.267625 dv-cinder-840516-1-iscsi devstack@n-api.service[128468]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 21:50:50.477732 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 21:50:50.493319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 21:50:51.288919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:50:51.288919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: from cryptography.utils import int_from_bytes May 13 21:50:51.289256 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:50:51.289256 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: from cryptography.utils import int_from_bytes May 13 21:50:51.291115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:50:51.291115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: from cryptography.utils import int_from_bytes May 13 21:50:51.291453 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 21:50:51.291453 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: from cryptography.utils import int_from_bytes May 13 21:50:53.726122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 21:50:53.726802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 21:50:53.726963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 21:50:53.727332 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 21:50:53.727595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 21:50:53.727986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.728318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.728651 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.728976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.729310 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.729627 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.729955 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.730282 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.730616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.730912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.731237 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.731571 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840516-1-iscsi {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.731900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.732216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.732534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.733401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.733725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.734057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.734374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.734903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736382 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736613 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.736931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.737260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.737579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.737911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.738231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.738636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840516-1-iscsi {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.738987 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.739305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.739627 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.739951 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 21:50:53.740344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.740421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 21:50:53.740491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.740676 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.740769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 21:50:53.740982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.741135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 21:50:53.741312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.741470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 21:50:53.741651 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.741804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.741994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.742148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.742546 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.742736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.742889 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743639 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743788 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.743937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744087 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744653 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.744954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745256 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840516-1-iscsi {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.745897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746045 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746347 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746644 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.746836 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.747892 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.748049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.748198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.748362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.748576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.749219 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.749524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.750956 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.751124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.751368 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.751532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.751676 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.751884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752329 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.752921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840516-1-iscsi {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.753792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.754925 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755236 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755380 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755669 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.755964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756268 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.756880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757317 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757762 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.757914 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758679 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758845 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.758987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.759137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.759285 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.759452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.759697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.759854 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760003 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760310 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.760885 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761172 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761554 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.761862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.762960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763113 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763269 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763411 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.763855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764009 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764190 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764340 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764489 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764631 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.764929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765666 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765814 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.765964 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766415 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.766875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767622 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.767933 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768084 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768232 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768379 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768530 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.768968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769116 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769734 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.769968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770117 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.770872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771156 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771296 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771437 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.771891 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772033 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772760 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.772908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773064 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773219 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.773812 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.773953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.774103 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.774245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.774385 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.774532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.774682 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.774864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.775022 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.775166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.775307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.775456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.775615 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.775771 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.775921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.776071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.776220 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.776363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.776512 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.776662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.776804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.776945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.777096 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.777238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.777387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.777550 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.777700 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.777849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.778008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.778158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.778306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.778455 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.778596 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.778766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.778991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.779135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.779276 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.779424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.779589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.779764 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.779913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.780141 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.780288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.780437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.780580 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.780729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.780882 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.781023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.781164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.781305 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.781462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.781614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.781766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.781908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.782057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.782206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.782353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.782504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.782646 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.782842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.782986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.783137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.783294 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.783445 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.783593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.783734 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.783734 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.784009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.784164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.784312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.784463 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.784616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.784768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.784910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.785058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.785207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.785359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.785500 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.785647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.785796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.785944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 21:50:53.786095 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786243 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.786955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787160 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787336 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787529 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.787903 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788096 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788385 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788747 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.788878 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789525 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.789869 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790662 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.790876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791021 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791470 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.791898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.792992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793440 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793737 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.793898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794189 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794503 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794842 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.794986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.795158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.795328 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796310 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796468 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796795 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.796958 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797116 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797603 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.797939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.798900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.799976 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800270 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800418 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800570 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.800881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801316 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.801916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.802073 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.802227 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.802398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.802548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.802696 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803495 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803812 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.803959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.804933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805552 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805708 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.805856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806011 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806171 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806327 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806521 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.806894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807043 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807511 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.807994 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808173 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808494 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.808963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809589 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809737 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.809899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810205 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810500 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810669 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.810855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.811056 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.811693 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.811841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.811989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812300 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812455 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.812911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813394 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813543 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813836 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.813996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814292 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814789 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.814961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815599 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815755 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.815911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816513 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.816981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817295 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.817913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818692 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.818876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819035 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819191 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819349 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.819957 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.820898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.821972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.822935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823547 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823701 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.823856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824174 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824636 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.824953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825102 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825428 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.825904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.826901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827050 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827812 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.827968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828123 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.828892 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829525 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829674 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.829970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830273 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830577 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.830915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831231 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831543 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.831994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832152 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832596 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832743 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.832890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833220 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833370 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833524 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833672 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.833897 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834055 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834657 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.834855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835321 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.835935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836083 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836830 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.836986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837607 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.837907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838074 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838224 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838664 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.838834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839160 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.839915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840841 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.840991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841156 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841619 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.841924 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842255 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842417 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.842921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.843893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.844964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.845921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846232 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846379 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846675 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.846910 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847699 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.847854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848612 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848760 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.848921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849072 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849389 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849711 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.849861 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850010 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850796 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.850947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851112 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851436 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.851890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.852970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853294 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.853740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854502 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.854978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855402 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855641 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855866 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.855950 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856261 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.856908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.857116 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.857218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.857437 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.857540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.857746 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.858336 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.858618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.858739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.858953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859358 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859669 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.859984 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860298 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860819 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.860923 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861138 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861529 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861744 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.861845 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862149 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862367 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862601 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862723 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862887 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.862979 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863073 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863789 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.863945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864272 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.864911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865224 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865539 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865639 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.865953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866815 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.866912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.867136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.867484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.867698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.867791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868317 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868409 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868636 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868730 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.868950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869041 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869906 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.869998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.870985 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871192 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.871907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.872883 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.873083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.873268 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.873485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874181 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874336 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.874997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.875975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876294 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.876898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877048 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877662 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877818 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.877990 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878150 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.878972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.879895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880055 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880672 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.880984 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.881132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.881299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.881450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.881607 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.881782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.882512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.882682 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.882860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883035 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883513 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883661 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.883977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884140 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884748 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.884895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885202 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885499 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.885965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886417 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886756 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.886914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.887998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.888922 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.889092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.889759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.889917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890075 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890225 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.890860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891023 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891172 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891635 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.891958 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892107 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.892889 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893678 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893827 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.893982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.894272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.894272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.894567 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.894753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.894911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895220 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895385 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.895988 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896303 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896459 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896762 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.896931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897402 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897707 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.897865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898016 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898473 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898628 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.898982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899427 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.899905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900788 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.900945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901093 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.901876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902660 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.902847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903317 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.903932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.904093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.904243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.904400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.904556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.904728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.905423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.905584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.905741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.905890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906045 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906349 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906666 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.906944 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907410 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907601 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.907977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908258 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908413 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908554 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.908867 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909179 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.909850 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910000 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910316 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910623 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910808 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.910961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911587 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.911894 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912369 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.912834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913455 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913603 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.913920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914069 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914537 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.914911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915230 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915695 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.915846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.916916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917077 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917227 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.917848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918154 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918807 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.918964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919440 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.919910 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920067 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920557 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.920865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921022 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921338 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921635 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.921911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922177 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922594 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.922950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923585 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.923963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924123 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924752 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.924901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925196 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925662 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925810 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.925965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926462 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926629 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.926971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927440 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927591 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927739 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.927886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928708 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.928881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929262 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.929869 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.930879 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931358 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931514 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931827 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.931978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.932139 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.932288 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.932436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.932593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.932759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933619 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933705 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933903 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.933995 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934284 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934415 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.934881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935217 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935437 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935537 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.935967 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936424 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936581 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.936987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937138 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937287 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937439 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.937902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938519 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938669 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.938856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939807 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.939965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940570 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.940878 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941807 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.941956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942113 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942263 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942581 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.942934 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943101 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.943876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944059 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944523 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.944840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945121 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945285 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945742 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.945891 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.946989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947297 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947455 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.947918 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948701 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.948856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949423 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949588 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.949940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950244 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950721 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.950890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.951050 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.951208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.951371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.951549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952383 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.952998 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.953146 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.953308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.953463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.954842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.954947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955621 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955714 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.955908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956012 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956873 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.956960 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957212 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957347 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957452 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.957982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958405 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.958959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959701 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.959904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960539 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.960909 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961562 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961874 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.961969 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962861 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.962957 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963179 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963500 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963851 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.963956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.964175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.964295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.964508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.964733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.964830 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965732 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.965827 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.966993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.967096 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.967864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.967970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.968954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.969868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970498 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970718 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.970817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971027 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971120 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971454 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971652 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.971959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972268 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972358 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.972982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.973196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.973291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.973534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.973629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.973887 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974338 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974633 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.974971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975189 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975825 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.975936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976180 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976325 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976871 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.976977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977223 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977852 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.977965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.978169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.978492 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.978611 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.978725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.978851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.979849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.980872 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981191 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981297 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981852 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.981993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.982136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.982331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.982464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.982655 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.982804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983033 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983462 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983682 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.983819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984646 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.984961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985284 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.985912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986539 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.986998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987528 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987843 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.987944 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988262 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988794 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.988903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.989058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 21:50:53.989181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.989434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.989775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.990099 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.990429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.990777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.991113 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.991431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.991761 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.992095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.992684 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.993005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.993349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.993672 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.993995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.994321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.994643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.995021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.995351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.995689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.996026 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.996342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.996676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.997004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.997335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.997664 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.997985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.998325 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.998676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.999024 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.999354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:53.999681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.000003 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.000332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.000658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.000994 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.001329 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.001651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.002001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.002324 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.002684 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.003041 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.003399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.003741 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.004068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.004397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.004718 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 21:50:54.004972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 21:50:54.012606 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_db.sqlalchemy.engines [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.028718 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_db.sqlalchemy.engines [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.077876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.context [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415e9a87-7af9-4b21-ab24-8ddfa7580a0e(cell1) {{(pid=128489) load_cells /opt/stack/nova/nova/context.py:464}} May 13 21:50:54.082256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:50:54.083858 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:50:54.084672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:50:54.086612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:50:54.094364 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.context [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),415e9a87-7af9-4b21-ab24-8ddfa7580a0e(cell1) {{(pid=128488) load_cells /opt/stack/nova/nova/context.py:464}} May 13 21:50:54.098381 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_db.sqlalchemy.engines [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.098830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:50:54.100448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:50:54.100585 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_db.sqlalchemy.engines [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.101283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:50:54.103308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:50:54.115415 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_db.sqlalchemy.engines [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.116824 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_db.sqlalchemy.engines [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.266047 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_db.sqlalchemy.engines [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.287432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_db.sqlalchemy.engines [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 21:50:54.605212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: WARNING keystonemiddleware.auth_token [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:50:54.613423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: WARNING keystonemiddleware.auth_token [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:50:54.618369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: WARNING keystonemiddleware.auth_token [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:50:54.626570 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: WARNING keystonemiddleware.auth_token [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:50:54.962688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: WARNING keystonemiddleware.auth_token [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:50:54.969383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: WARNING keystonemiddleware.auth_token [None req-ae3a691e-31c7-4ed3-94d7-cc3e18a536bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:50:54.974667 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f59e19c0 pid: 128489 (default app) May 13 21:50:54.976472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: WARNING keystonemiddleware.auth_token [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 21:50:54.982601 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: WARNING keystonemiddleware.auth_token [None req-6f3893a1-df41-4fde-9786-28c177e7b960 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 21:50:54.988564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f59e19c0 pid: 128488 (default app) May 13 21:51:37.324097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-91184309-8d73-404b-b3db-6b4a2ee7cf5b tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Action: 'create', calling method: .version_select at 0x7fb7dce15280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2084726737"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:37.410588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b5e15a5b-089c-462d-9ec8-783b432eda50 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Action: 'create', calling method: .version_select at 0x7fb7dce15280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2033232187", "metadata": {"Type": "work"}}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:39.051213 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-91184309-8d73-404b-b3db-6b4a2ee7cf5b tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.136866 May 13 21:51:39.052201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1154 bytes} [Fri May 13 21:51:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3139 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 21:51:39.213483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1225362928", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "networks": [{"uuid": "e31f46df-974a-465f-8ac4-4ac009072a8a"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:39.243976 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b5e15a5b-089c-462d-9ec8-783b432eda50 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.801172 May 13 21:51:39.245390 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 1/2] 10.222.0.35 () {60 vars in 1155 bytes} [Fri May 13 21:51:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2804 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 13 21:51:39.265083 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5759ad6c-6398-4278-b6ce-24bdd7e1fa19 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc70280>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:39.416718 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5759ad6c-6398-4278-b6ce-24bdd7e1fa19 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 200 len: 345 microversion: 2.1 time: 0.169757 May 13 21:51:39.417299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:39 2022] GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:39.423248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-761c6919-242b-4c63-aeca-df6adabc8091 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc70310>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:39.474748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] validate_networks() for [('e31f46df-974a-465f-8ac4-4ac009072a8a', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:51:39.542742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-761c6919-242b-4c63-aeca-df6adabc8091 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 353 microversion: 2.1 time: 0.123730 May 13 21:51:39.548130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 3/4] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:39 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:40.436234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-35729a56-d245-4705-865e-f2d6e4dd7160 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc70a60>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:40.524946 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-35729a56-d245-4705-865e-f2d6e4dd7160 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 200 len: 346 microversion: 2.1 time: 0.097870 May 13 21:51:40.528012 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 4/5] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:40 2022] GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:51:40.552313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-95fc43b3-751a-4707-a38b-d00bf4bb804c tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Action: 'create', calling method: .version_select at 0x7fb7dcc780d0>, body: {"snapshot": {"volume_id": "50d87868-78f0-4518-a8f3-279c68751b4b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-491007859"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:40.993796 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-95fc43b3-751a-4707-a38b-d00bf4bb804c tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.447253 May 13 21:51:40.995563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 5/6] 10.222.0.35 () {60 vars in 1161 bytes} [Fri May 13 21:51:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.007830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bb0f0767-08d5-4561-afae-8d16d25266e9 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc70b80>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.094603 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bb0f0767-08d5-4561-afae-8d16d25266e9 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 354 microversion: 2.1 time: 0.093179 May 13 21:51:41.095219 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 6/7] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:40 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.106881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-51f00696-ea7d-44cd-8a2b-9922669268e3 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc70160>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.162869 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-51f00696-ea7d-44cd-8a2b-9922669268e3 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 286 microversion: 2.1 time: 0.066531 May 13 21:51:41.163770 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 7/8] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.169695 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4840fa0f-0699-4a3a-82a9-1f1bc74bb969 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc78160>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.255210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4840fa0f-0699-4a3a-82a9-1f1bc74bb969 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 354 microversion: 2.1 time: 0.089918 May 13 21:51:41.255816 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 8/9] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.261360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ce448a84-d480-404f-9e6c-257615e97ab9 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc70040>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.354472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ce448a84-d480-404f-9e6c-257615e97ab9 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.097569 May 13 21:51:41.355043 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 9/10] 10.222.0.35 () {58 vars in 1139 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.362916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:51:41.363960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:51:41.364767 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:51:41.365380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:51:41.366328 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:51:41.373846 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6ffd112a-d887-453e-855c-0c5960aef0b2 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc784c0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.397464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:41.398334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:41.400887 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:41.401555 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:41.441388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Getting quotas for project 39174f764455497c99b2fc47838407f8. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:51:41.449457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Getting quotas for user 1315f98467d8426094229e3a31c618f3 and project 39174f764455497c99b2fc47838407f8. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:51:41.467668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:51:41.471997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:51:41.480093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6ffd112a-d887-453e-855c-0c5960aef0b2 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 202 len: 0 microversion: 2.1 time: 0.123775 May 13 21:51:41.488502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 10/11] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:51:41 2022] DELETE /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:51:41.494855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e93787ce-d9d1-4b8f-9bc2-e13cf6a9135e tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc78280>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.533480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e93787ce-d9d1-4b8f-9bc2-e13cf6a9135e tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 286 microversion: 2.1 time: 0.042661 May 13 21:51:41.534339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 11/12] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.539497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-94244926-d2fe-4d77-9a4e-2781427c62c0 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc70b80>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.592315 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-18608135-8104-4284-ac95-7a6067e82449 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538502 May 13 21:51:41.593647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 2/13] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:51:41.604435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-19b445b0-ba4a-43fe-bbad-92cf8ba1bb1d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:41.605173 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-19b445b0-ba4a-43fe-bbad-92cf8ba1bb1d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:41.654499 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-94244926-d2fe-4d77-9a4e-2781427c62c0 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 353 microversion: 2.1 time: 0.119257 May 13 21:51:41.655927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 12/14] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:41.912679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-19b445b0-ba4a-43fe-bbad-92cf8ba1bb1d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:41.936906 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-19b445b0-ba4a-43fe-bbad-92cf8ba1bb1d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1215 microversion: 2.1 time: 0.336825 May 13 21:51:41.940046 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 3/15] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:41 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:51:42.549024 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bf6397eb-2b88-49ce-b258-56a087218710 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc70700>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:42.627528 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bf6397eb-2b88-49ce-b258-56a087218710 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 286 microversion: 2.1 time: 0.085671 May 13 21:51:42.628791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 13/16] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:42 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:42.668205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d8588d6f-7a6a-4e05-83e0-3bfcf45baccb tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc6f310>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:42.787318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d8588d6f-7a6a-4e05-83e0-3bfcf45baccb tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 353 microversion: 2.1 time: 0.123102 May 13 21:51:42.792656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 4/17] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:42 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:42.958954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d9b5c011-e425-4c6b-8d08-d58cef7c5e2a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:42.961163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d9b5c011-e425-4c6b-8d08-d58cef7c5e2a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:43.161607 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d9b5c011-e425-4c6b-8d08-d58cef7c5e2a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:43.190069 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d9b5c011-e425-4c6b-8d08-d58cef7c5e2a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1215 microversion: 2.1 time: 0.236398 May 13 21:51:43.192159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 14/18] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:42 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:43.641663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3cc7864c-fe6c-49f6-8cbc-256da4876af7 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dc3294c0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:43.703175 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3cc7864c-fe6c-49f6-8cbc-256da4876af7 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 286 microversion: 2.1 time: 0.066989 May 13 21:51:43.704809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 5/19] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:43 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:43.802366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fe3f7808-7cf2-48d6-895b-37590cfcc3f7 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dcc40040>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:43.913837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-fe3f7808-7cf2-48d6-895b-37590cfcc3f7 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 200 len: 353 microversion: 2.1 time: 0.118062 May 13 21:51:43.915088 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 15/20] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:43 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:51:44.209814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:44.210663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:44.233397 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:44.234376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:44.235502 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:44.236119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:44.552900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:44.583650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2955aecd-ab52-4a75-bc3f-ec9504475424 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1211 microversion: 2.1 time: 0.375210 May 13 21:51:44.585602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 6/21] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:44 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1211 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:44.716072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-452875c4-98bd-4255-8e17-276d4f6cb177 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc4d1f0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:44.767164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-452875c4-98bd-4255-8e17-276d4f6cb177 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 287 microversion: 2.1 time: 0.055259 May 13 21:51:44.768260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 16/22] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:44 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:44.782019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a942e5a8-628d-4b95-8802-a5d5a05a78e4 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dc2a4a60>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:44.905569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a942e5a8-628d-4b95-8802-a5d5a05a78e4 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 202 len: 0 microversion: 2.1 time: 0.129218 May 13 21:51:44.906841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 7/23] 10.222.0.35 () {58 vars in 1253 bytes} [Fri May 13 21:51:44 2022] DELETE /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:51:44.915780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-66a9fe6f-fbc2-40d6-b806-0d1f8d5992e5 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcc4d940>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:44.929611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a50e280e-893b-4f47-a870-8815e53c4782 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Calling method '.version_select at 0x7fb7dc2b13a0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:45.010168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-a50e280e-893b-4f47-a870-8815e53c4782 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] HTTP exception thrown: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. May 13 21:51:45.017341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-66a9fe6f-fbc2-40d6-b806-0d1f8d5992e5 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 200 len: 286 microversion: 2.1 time: 0.105749 May 13 21:51:45.026857 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 17/24] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:44 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a50e280e-893b-4f47-a870-8815e53c4782 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Request method failure captured: May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 HTTP/1.1 May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftLoqQWUCXHAQ6bh4bLB1EzW5OgoLwvnOBkX6ELCUYcDHOr94e6-qivdl3BpNG7H_8RBDjHDHxQBrC7iLPHakK7MgiAFxoNfsURdJ_X8cm6IFHuNPyYq5_luIbv10pac6rCxg1OYTCXYfBjdb0SCWcJQJs0ZVkF289EWlKWHrXr0T3o May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 51ed5e55a27c4adca6394a55b5cbd7aa May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesGetTestJSON-765542320 May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:51:45.035893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/51ed5e55a27c4adca6394a55b5cbd7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/51ed5e55a27c4adca6394a55b5cbd7aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_51ed5e55a27c4adca6394a55b5cbd7aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/51ed5e55a27c4adca6394a55b5cbd7aa"}]}] May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesGetTestJSON-765542320 May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 51ed5e55a27c4adca6394a55b5cbd7aa May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesGetTestJSON-765542320 May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesGetTestJSON-765542320-project May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ff694cc1ed2d4b99a2dbfaeffcb071d0 May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesGetTestJSON-765542320-project May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '0d0d3839-ca4d-4967-bbfe-9231d5b7acd9'} May 13 21:51:45.036986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. (HTTP 404) (Request-ID: req-4d53f86f-3a2d-4297-aac0-530ee4262679) May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:45.037593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:45.038750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 21:51:45.039773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. May 13 21:51:45.040864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:45.045880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a50e280e-893b-4f47-a870-8815e53c4782 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] Returning 404 to user: Volume 0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:51:45.049651 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a50e280e-893b-4f47-a870-8815e53c4782 tempest-VolumesGetTestJSON-765542320 tempest-VolumesGetTestJSON-765542320-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9" status: 404 len: 109 microversion: 2.1 time: 0.122775 May 13 21:51:45.052071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 8/25] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:44 2022] GET /compute/v2.1/os-volumes/0d0d3839-ca4d-4967-bbfe-9231d5b7acd9 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:51:45.604542 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:45.605671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:45.619389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:45.619877 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:45.635549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:45.635969 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:46.032223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ccf08ffc-012e-41e6-aeb8-41da6c29ec35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dc2a4f70>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:46.056080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:46.076395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-ccf08ffc-012e-41e6-aeb8-41da6c29ec35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] HTTP exception thrown: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ccf08ffc-012e-41e6-aeb8-41da6c29ec35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Request method failure captured: May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd HTTP/1.1 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftLnoZ6e8jC3N9WLtYYcJpwBpJ2YBcPZoOabCUgvPXtm_RzCZYv9pf8Q8Fn-1M-yn8EprzSicI1FS3psNeic3mM0pYYPl8KWXeSGl0DSmBFZL4jkuk_gm6JAqAfdKEp32ldxJDVh-adFyf8wmTlf8UPMIaBi2zWjbsuzF8ZGUS_3Ru0 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:51:46.079272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/cd76838c6c91427f8b0331f5338afeff"}]}] May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: e456da1e33c14bafa22f975abfc905bc May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'bbec13b6-b1d2-4873-a20d-d2af2903accd'} May 13 21:51:46.080538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. (HTTP 404) (Request-ID: req-3fc7295e-47d2-4316-9d26-0be9079bfd1f) May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.081341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:46.082404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 21:51:46.083540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. May 13 21:51:46.084837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:51:46.086345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ccf08ffc-012e-41e6-aeb8-41da6c29ec35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Returning 404 to user: Snapshot bbec13b6-b1d2-4873-a20d-d2af2903accd could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:51:46.088355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ccf08ffc-012e-41e6-aeb8-41da6c29ec35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd" status: 404 len: 111 microversion: 2.1 time: 0.059308 May 13 21:51:46.090645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 9/26] 10.222.0.35 () {58 vars in 1250 bytes} [Fri May 13 21:51:46 2022] GET /compute/v2.1/os-snapshots/bbec13b6-b1d2-4873-a20d-d2af2903accd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:51:46.091717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-dba592b9-dcd2-45f4-a269-b15804acdeee tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1273 microversion: 2.1 time: 0.494062 May 13 21:51:46.098748 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 18/27] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:45 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1273 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:46.121395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0b9bdfef-305c-4a5a-9c2e-2756d54989b0 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dc2bf790>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:46.265090 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0b9bdfef-305c-4a5a-9c2e-2756d54989b0 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 202 len: 0 microversion: 2.1 time: 0.170455 May 13 21:51:46.270174 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 10/28] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:51:46 2022] DELETE /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:51:46.275084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-44d81c4b-ef35-474c-a9cf-9e74219bdc35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcbc5a60>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:46.443428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-44d81c4b-ef35-474c-a9cf-9e74219bdc35 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 200 len: 345 microversion: 2.1 time: 0.172303 May 13 21:51:46.444093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 19/29] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:46 2022] GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:51:47.112929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:47.113710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:47.127350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:47.128160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:47.129253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:47.130233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:47.456034 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-11dae008-15a6-4156-a01d-cbd3e3f72502 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcbd00d0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:47.532158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-11dae008-15a6-4156-a01d-cbd3e3f72502 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] HTTP exception thrown: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-11dae008-15a6-4156-a01d-cbd3e3f72502 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Request method failure captured: May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b HTTP/1.1 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftLnoZ6e8jC3N9WLtYYcJpwBpJ2YBcPZoOabCUgvPXtm_RzCZYv9pf8Q8Fn-1M-yn8EprzSicI1FS3psNeic3mM0pYYPl8KWXeSGl0DSmBFZL4jkuk_gm6JAqAfdKEp32ldxJDVh-adFyf8wmTlf8UPMIaBi2zWjbsuzF8ZGUS_3Ru0 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:51:47.536919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/cd76838c6c91427f8b0331f5338afeff"}]}] May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: e456da1e33c14bafa22f975abfc905bc May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '50d87868-78f0-4518-a8f3-279c68751b4b'} May 13 21:51:47.538315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. (HTTP 404) (Request-ID: req-23075e8c-84f5-4fd5-ab49-7a531a545698) May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.539027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:47.539990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 21:51:47.541039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-11dae008-15a6-4156-a01d-cbd3e3f72502 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Returning 404 to user: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:51:47.542061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-11dae008-15a6-4156-a01d-cbd3e3f72502 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 404 len: 109 microversion: 2.1 time: 0.086406 May 13 21:51:47.550839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 20/30] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:47 2022] GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:51:47.555826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-126f4d37-af73-427f-8e7a-9493e41d2a07 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcb76dc0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:47.632724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-126f4d37-af73-427f-8e7a-9493e41d2a07 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] HTTP exception thrown: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-126f4d37-af73-427f-8e7a-9493e41d2a07 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Request method failure captured: May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b HTTP/1.1 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftLnoZ6e8jC3N9WLtYYcJpwBpJ2YBcPZoOabCUgvPXtm_RzCZYv9pf8Q8Fn-1M-yn8EprzSicI1FS3psNeic3mM0pYYPl8KWXeSGl0DSmBFZL4jkuk_gm6JAqAfdKEp32ldxJDVh-adFyf8wmTlf8UPMIaBi2zWjbsuzF8ZGUS_3Ru0 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:51:47.634635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/cd76838c6c91427f8b0331f5338afeff"}]}] May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: e456da1e33c14bafa22f975abfc905bc May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '50d87868-78f0-4518-a8f3-279c68751b4b'} May 13 21:51:47.635767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. (HTTP 404) (Request-ID: req-51a9820e-b815-4634-941b-fa980c0892a2) May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.636431 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:51:47.637409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 21:51:47.638972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-126f4d37-af73-427f-8e7a-9493e41d2a07 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Returning 404 to user: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-126f4d37-af73-427f-8e7a-9493e41d2a07 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 404 len: 109 microversion: 2.1 time: 0.084133 May 13 21:51:47.643275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 21/31] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:51:47 2022] DELETE /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:51:47.654900 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0d352526-f33b-404d-bcd4-0e06b9afca30 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Calling method '.version_select at 0x7fb7dcb76940>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:47.726681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-0d352526-f33b-404d-bcd4-0e06b9afca30 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] HTTP exception thrown: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0d352526-f33b-404d-bcd4-0e06b9afca30 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Request method failure captured: May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b HTTP/1.1 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftLnoZ6e8jC3N9WLtYYcJpwBpJ2YBcPZoOabCUgvPXtm_RzCZYv9pf8Q8Fn-1M-yn8EprzSicI1FS3psNeic3mM0pYYPl8KWXeSGl0DSmBFZL4jkuk_gm6JAqAfdKEp32ldxJDVh-adFyf8wmTlf8UPMIaBi2zWjbsuzF8ZGUS_3Ru0 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:51:47.729927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_cd76838c6c91427f8b0331f5338afeff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/cd76838c6c91427f8b0331f5338afeff"}]}] May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: cd76838c6c91427f8b0331f5338afeff May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1732263370 May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: e456da1e33c14bafa22f975abfc905bc May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1732263370-project May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '50d87868-78f0-4518-a8f3-279c68751b4b'} May 13 21:51:47.732031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. (HTTP 404) (Request-ID: req-979dd956-90c4-4551-9ebc-26bfac5312de) May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.732651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:51:47.733548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 21:51:47.734435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0d352526-f33b-404d-bcd4-0e06b9afca30 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] Returning 404 to user: Volume 50d87868-78f0-4518-a8f3-279c68751b4b could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0d352526-f33b-404d-bcd4-0e06b9afca30 tempest-VolumesSnapshotsTestJSON-1732263370 tempest-VolumesSnapshotsTestJSON-1732263370-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b" status: 404 len: 109 microversion: 2.1 time: 0.090822 May 13 21:51:47.735424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 22/32] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:47 2022] GET /compute/v2.1/os-volumes/50d87868-78f0-4518-a8f3-279c68751b4b => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:51:48.673353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:48.682951 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6be1448c-6c04-4266-a00b-8bfdfbbb4c9d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 1.573987 May 13 21:51:48.693318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 11/33] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:47 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:49.718001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:49.719109 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:49.730203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:49.730667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:49.736430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:49.737107 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:50.435813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:50.456224 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0efee900-1e17-4b10-860f-5de6906deed2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.748283 May 13 21:51:50.471243 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 23/34] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:49 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:51.473311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:51.474517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:51.484637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:51.485097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:51.485904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:51.486398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:51.998251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:52.007003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1d7ee4b1-9b39-443a-99db-d8d4e699528b tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.537915 May 13 21:51:52.009623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 12/35] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:51 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:53.028168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:53.029434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:53.042854 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:53.045372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:53.046351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:53.046977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:53.135833 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-444a159b-5b99-4f09-b7e1-ce06cfa35c49 req-d7009dfd-d7ca-4eca-b555-c8e43277bc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc", "tag": "33b2d378-1acb-4b8e-945a-43a9d123744b"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:53.187549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-444a159b-5b99-4f09-b7e1-ce06cfa35c49 req-d7009dfd-d7ca-4eca-b555-c8e43277bc54 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:53.188076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-444a159b-5b99-4f09-b7e1-ce06cfa35c49 req-d7009dfd-d7ca-4eca-b555-c8e43277bc54 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:53.220950 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-444a159b-5b99-4f09-b7e1-ce06cfa35c49 req-d7009dfd-d7ca-4eca-b555-c8e43277bc54 service nova] Creating event network-changed:33b2d378-1acb-4b8e-945a-43a9d123744b for instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc on hv-cinder-84051 May 13 21:51:53.237543 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-444a159b-5b99-4f09-b7e1-ce06cfa35c49 req-d7009dfd-d7ca-4eca-b555-c8e43277bc54 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 21:51:53.253028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:53.254272 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:53.257212 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:53.258685 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:53.272167 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.compute.rpcapi [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 21:51:53.273554 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=128488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 21:51:53.327495 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f0b3a65c-ee58-4c56-af92-2c139c5f86a7 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739166 May 13 21:51:53.328526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 24/36] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:53.360895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:53.372470 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5e0aaf91-4b3b-4db3-8831-cdf8cf9c9184 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.349227 May 13 21:51:53.373480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 13/37] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:53 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:54.210185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a6b77274-a45b-4d58-a4d2-2d5fa2ac13b8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: .version_select at 0x7fb7dc2aaa60>, body: {"keypair": {"name": "tempest-keypair-1078324895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcnLC1CQvtc+FghJJZeQ2Mf4dS+P0nym3cW5VqfIQJcCDXfBysxRzm6KLEKmqDZngFY/WEdoIGS0sTnqBRTQqiupOLb479Efvjz1ozFCvfHj0ZMxGGM5dhYml7fbgodmQ=="}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:54.325430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-a6b77274-a45b-4d58-a4d2-2d5fa2ac13b8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:51:54.337924 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-a6b77274-a45b-4d58-a4d2-2d5fa2ac13b8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for user 0a1425d092844a2e9b8a917dc9981b32 and project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:51:54.393938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:54.394594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:54.404771 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:54.405223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:54.406164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:54.406983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:54.440433 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a6b77274-a45b-4d58-a4d2-2d5fa2ac13b8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.512616 May 13 21:51:54.441610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 25/38] 10.222.0.35 () {62 vars in 1199 bytes} [Fri May 13 21:51:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 515 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 21:51:54.749893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:54.761813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bd027d48-4cc7-4e69-b8d5-1ec9a4046041 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.375620 May 13 21:51:54.773638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 14/39] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:54 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:55.548961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1550168127", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:55.771489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] validate_networks() for [('90541eb1-b174-4a95-af44-3c1eff2260dd', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:51:55.785798 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:55.786424 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:55.815641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:55.816016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:55.816801 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:55.817237 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:57.237697 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:57.250535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9012368d-1280-4451-b113-0b1f02c8c8cb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 1.474630 May 13 21:51:57.251161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 15/40] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:55 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:57.301028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-789deec8-9c9c-4523-8003-79b4806b65b0 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1e5a60>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:57.634068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-789deec8-9c9c-4523-8003-79b4806b65b0 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/f5d5d8d1-77b7-4abf-b6b3-a74c42443012" status: 200 len: 350 microversion: 2.1 time: 0.348563 May 13 21:51:57.635259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 16/41] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:51:57 2022] GET /compute/v2.1/os-volumes/f5d5d8d1-77b7-4abf-b6b3-a74c42443012 => generated 350 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:51:58.268591 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:58.270304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:58.289724 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:58.305856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:58.307003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:58.314908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:58.664131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:51:58.665428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:51:58.666186 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:51:58.666824 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:51:58.667486 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:51:58.691115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:58.691916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:58.694104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:58.695560 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:58.751774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:58.760985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:51:58.772617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-68f8a965-3dac-47ff-8ac7-460a19779b12 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.506159 May 13 21:51:58.773322 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for user 6b11a3de8b71482594a04ab7e53a94bd and project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:51:58.776196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 17/42] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:58 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:58.803902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:51:58.807076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:51:58.980434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-17e4163d-a747-46dc-a129-69efe1dbbbbc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.072979 May 13 21:51:58.982562 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 26/43] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:51:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:51:58.997066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-93df784a-9bc9-4920-86e1-1cb53fd31b68 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:58.997066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-93df784a-9bc9-4920-86e1-1cb53fd31b68 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:59.201904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-93df784a-9bc9-4920-86e1-1cb53fd31b68 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:51:59.209451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-93df784a-9bc9-4920-86e1-1cb53fd31b68 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1222 microversion: 2.1 time: 0.219684 May 13 21:51:59.210038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 18/44] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:58 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:51:59.537033 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1144850052", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:51:59.673720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] validate_networks() for [('90541eb1-b174-4a95-af44-3c1eff2260dd', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:51:59.796089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:51:59.796681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:51:59.815064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:59.830057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:51:59.833404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:51:59.837558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:00.574265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:00.583176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-607f1d66-a88b-4044-9dcb-9d18324944df tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.793732 May 13 21:52:00.584418 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 19/45] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:51:59 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:00.597008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-653286820", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54bb408e-38dc-4d63-b590-fa8bf9ca4da7"}], "security_groups": [{"name": "tempest-securitygroup--573556717"}], "key_name": "tempest-keypair-1078324895", "user_data": "}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:00.988658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] validate_networks() for [('54bb408e-38dc-4d63-b590-fa8bf9ca4da7', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:52:01.784833 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:52:01.787397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:52:01.788938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:52:01.789613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:52:01.790050 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:52:01.803447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:01.804159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:01.805772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:01.806508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:01.828045 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:52:01.833476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for user 6b11a3de8b71482594a04ab7e53a94bd and project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:52:01.847307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:52:01.850372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:52:01.896935 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-25343438-10f6-4785-8a80-57910a2cfef1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.365210 May 13 21:52:01.903006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 27/46] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:51:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:52:01.903006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:01.903311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:01.909690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:01.910084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:01.910897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:01.911362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:02.141679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:52:02.142162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:52:02.142594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:52:02.143521 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:52:02.143942 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:52:02.160920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:02.161314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:02.162116 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:02.162553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:02.180942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:02.183250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:52:02.187478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for user 0a1425d092844a2e9b8a917dc9981b32 and project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:52:02.195563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7461c5da-4d11-4a46-b6c9-a4a08c2da2fb tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.296919 May 13 21:52:02.197532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 28/47] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:01 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:02.203010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-189190c6-5fe7-4663-90b0-c4988c406fb2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:02.203830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-189190c6-5fe7-4663-90b0-c4988c406fb2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:02.212279 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:52:02.214595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:52:02.265756 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b9321032-8241-4906-955e-d053698891df tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.680050 May 13 21:52:02.267067 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 20/48] 10.222.0.35 () {62 vars in 1187 bytes} [Fri May 13 21:52:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 21:52:02.289632 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:02.290260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:02.306165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-189190c6-5fe7-4663-90b0-c4988c406fb2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:02.314260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-189190c6-5fe7-4663-90b0-c4988c406fb2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1222 microversion: 2.1 time: 0.114901 May 13 21:52:02.314858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 29/49] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:02 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:02.397264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:02.403640 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:02.405165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:02.406274 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3341b8d9-c857-40a0-ac70-55f11ab0ce3f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1281 microversion: 2.20 time: 0.133671 May 13 21:52:02.406859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 21/50] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:02 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:02.566973 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cb8da9e4-b4e0-44ee-a622-dd80c6653880 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1df8b0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:02.697918 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cb8da9e4-b4e0-44ee-a622-dd80c6653880 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/b557d6f3-cd2f-4c8c-8f5f-7ce404c2151e" status: 200 len: 350 microversion: 2.1 time: 0.134679 May 13 21:52:02.699020 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 30/51] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:52:02 2022] GET /compute/v2.1/os-volumes/b557d6f3-cd2f-4c8c-8f5f-7ce404c2151e => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:03.212490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:03.213106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:03.220032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.220516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.221278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.221713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.331580 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:03.332203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:03.340902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.341597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.342613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.343306 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.350046 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:03.358069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-165b9697-f0da-4603-b24b-06efb0dd9b5d tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.149337 May 13 21:52:03.358722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 22/52] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:03 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:03.407190 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:03.414480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f22431fc-a480-4a4b-ad51-f87d8e766f15 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1226 microversion: 2.1 time: 0.086829 May 13 21:52:03.415092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 31/53] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:03 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:03.429258 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:03.429947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:03.436004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.436534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.437372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:03.437885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:03.500157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:03.508778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:03.510610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:03.512301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-43603fe9-23eb-4563-ad68-c896600ad5ac tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1285 microversion: 2.20 time: 0.086372 May 13 21:52:03.513039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 23/54] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:03 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:04.376690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:04.377346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:04.383920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.384382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.385185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.385629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.436413 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:04.438652 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:04.448968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.450162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.451107 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.451662 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.538636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:04.551207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4de040cc-1fd7-41aa-9f55-9c284f55953a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1226 microversion: 2.1 time: 0.119378 May 13 21:52:04.552220 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 24/55] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:04 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:04.565206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:04.565832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:04.568523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:04.572004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.572579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.573415 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:04.573915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:04.576826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9274283e-71e1-4403-825a-0115ee3bf46c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.205249 May 13 21:52:04.577884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 32/56] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:04 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:04.644493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:04.653216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:04.655021 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:04.656125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-685e5093-c51e-44e1-aeb8-2fedf18c3cfa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1285 microversion: 2.20 time: 0.094680 May 13 21:52:04.656679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 25/57] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:04 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:05.568067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:05.568661 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:05.574392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.574877 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.575633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.576066 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.594671 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:05.595516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:05.601921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.602462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.603318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.603822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.645597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:05.659079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1d25909c-97c4-4b29-b109-546862b6ecbf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1226 microversion: 2.1 time: 0.094516 May 13 21:52:05.659750 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 33/58] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:05 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:05.681390 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:05.681390 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:05.687090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.687791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.688313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:05.688748 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:05.771233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:05.781845 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-70518b7d-ef8d-4c09-97b2-6e230f25a950 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.191378 May 13 21:52:05.782933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 26/59] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:05 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:05.790238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:05.803305 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:05.804994 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:05.806689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ed5623e2-1f7b-463c-84c7-b4c0811cfaa0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1285 microversion: 2.20 time: 0.134987 May 13 21:52:05.807724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 34/60] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:05 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:52:06.228892 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e0c24a73-349e-4509-9ee7-9bc8eb7ca4e3 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1ffee0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.341145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e0c24a73-349e-4509-9ee7-9bc8eb7ca4e3 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/821bfbf8-9076-4778-8ce7-186df5f13973" status: 200 len: 350 microversion: 2.1 time: 0.116394 May 13 21:52:06.341846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 27/61] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes/821bfbf8-9076-4778-8ce7-186df5f13973 => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:06.354169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5aed7adc-3fb1-4349-9c0f-332c12186891 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc16d1f0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.445088 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5aed7adc-3fb1-4349-9c0f-332c12186891 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.094799 May 13 21:52:06.445654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 35/62] 10.222.0.35 () {58 vars in 1133 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:06.458088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0314a884-5449-4f13-a0ca-652cf8094914 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc25cb80>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.572363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0314a884-5449-4f13-a0ca-652cf8094914 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116982 May 13 21:52:06.573595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 28/63] 10.222.0.35 () {58 vars in 1148 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:06.588326 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-80c52149-cb06-44ac-9bde-e7ca2b68acf8 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1dfb80>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.688880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.689653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:06.692384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-80c52149-cb06-44ac-9bde-e7ca2b68acf8 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.109632 May 13 21:52:06.697789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:06.698252 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:06.699403 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 36/64] 10.222.0.35 () {58 vars in 1133 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:06.699766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:06.700216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:06.704485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-55faf0e7-a3e3-476b-98a8-9da161d7fe24 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1b4700>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.769979 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:06.777536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c8d2f4db-7373-498e-a539-7423d1531564 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1274 microversion: 2.1 time: 0.104999 May 13 21:52:06.785448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 29/65] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:06.798733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-55faf0e7-a3e3-476b-98a8-9da161d7fe24 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097953 May 13 21:52:06.799504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 37/66] 10.222.0.35 () {58 vars in 1166 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:06.800481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.801098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:06.808324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:06.809199 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:06.812397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2f808659-9256-4e62-860c-b324a4a23500 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1b4b80>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:06.821047 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:06.822649 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:07.017993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:07.026317 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ac7aaea3-b760-4c12-a2c7-2f736007fff8 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.229805 May 13 21:52:07.026937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 30/67] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:07.032240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:07.032834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:07.038661 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:07.039388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:07.040162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:07.040594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:07.103134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2f808659-9256-4e62-860c-b324a4a23500 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.295269 May 13 21:52:07.104082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 38/68] 10.222.0.35 () {58 vars in 1169 bytes} [Fri May 13 21:52:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:07.117546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f75e43e9-40e4-42f6-a97d-d8a4e3dab859 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1dfdc0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:07.125316 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:07.141263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:07.142890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:07.144300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-976069f0-f742-40cd-99c4-6ab477ef158a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1341 microversion: 2.20 time: 0.116005 May 13 21:52:07.144973 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 31/69] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:07 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1341 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:07.242662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f75e43e9-40e4-42f6-a97d-d8a4e3dab859 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.129639 May 13 21:52:07.243503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 39/70] 10.222.0.35 () {58 vars in 1154 bytes} [Fri May 13 21:52:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:07.254975 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5a67cded-949a-4e67-b47f-63192b6342fe tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1ae8b0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:07.405117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5a67cded-949a-4e67-b47f-63192b6342fe tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.153902 May 13 21:52:07.405782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 32/71] 10.222.0.35 () {58 vars in 1187 bytes} [Fri May 13 21:52:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:07.417546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c75729d5-e942-42fe-b066-826677df0ad5 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] Calling method '.version_select at 0x7fb7dc1df8b0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:07.634171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c75729d5-e942-42fe-b066-826677df0ad5 tempest-VolumesTestJSON-550383688 tempest-VolumesTestJSON-550383688-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.220612 May 13 21:52:07.635082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 40/72] 10.222.0.35 () {58 vars in 1154 bytes} [Fri May 13 21:52:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:07.795309 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:07.796110 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:07.806083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:07.806623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:07.807569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:07.808631 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:08.019686 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:08.031665 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c19adcab-f375-48b6-86e2-dd179c9d887b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1280 microversion: 2.1 time: 0.237891 May 13 21:52:08.032442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 33/73] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:07 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:08.045975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:08.047313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:08.056868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:08.057334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:08.061469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:08.061941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:08.164621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:08.165638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:08.175640 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:08.177802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:08.180726 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:08.181414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:08.362496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:08.371557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:08.374917 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:08.377141 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-44a47bb4-b3c3-4775-b544-1b2ae23d667b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1339 microversion: 2.20 time: 0.216889 May 13 21:52:08.390738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 34/74] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:08 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:08.532084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:08.540741 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b80f8929-ee3d-4f4a-a861-228ce7019978 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.500870 May 13 21:52:08.551350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 41/75] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:08 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:09.049236 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:09.049863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:09.057609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.058088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.063352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.063884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.228783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:09.240480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-eeecd970-5403-4c92-b051-c7156bc8c6d0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1280 microversion: 2.1 time: 0.195242 May 13 21:52:09.255862 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 35/76] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:09 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:09.404320 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:09.404938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:09.413195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.413653 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.416687 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.419445 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.507253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-51e455c7-917e-4cd2-8b86-8a5d6309dd78 req-34b5738e-f626-4c7a-8efa-8aef94559603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc", "name": "network-vif-plugged", "status": "completed", "tag": "33b2d378-1acb-4b8e-945a-43a9d123744b"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:09.525374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-51e455c7-917e-4cd2-8b86-8a5d6309dd78 req-34b5738e-f626-4c7a-8efa-8aef94559603 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.526063 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-51e455c7-917e-4cd2-8b86-8a5d6309dd78 req-34b5738e-f626-4c7a-8efa-8aef94559603 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.571311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-51e455c7-917e-4cd2-8b86-8a5d6309dd78 req-34b5738e-f626-4c7a-8efa-8aef94559603 service nova] Creating event network-vif-plugged:33b2d378-1acb-4b8e-945a-43a9d123744b for instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc on hv-cinder-84051 May 13 21:52:09.573193 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-51e455c7-917e-4cd2-8b86-8a5d6309dd78 req-34b5738e-f626-4c7a-8efa-8aef94559603 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128489) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 21:52:09.574947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.575928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.576948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.577702 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.594317 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.compute.rpcapi [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 21:52:09.595524 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=128489) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 21:52:09.643248 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8977b5b3-131b-46dd-86c4-7b30ad8c73c6 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235084 May 13 21:52:09.645846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 36/77] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:09.657255 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:09.658561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:09.668408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.669493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:09.671091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:09.671569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:10.247666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:10.259603 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:10.268413 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7f41ef78-18b1-4f7b-9552-f563940b87ed tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.620864 May 13 21:52:10.268608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:10.269558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 37/78] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:09 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:10.294846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:10.296616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:10.298736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:10.301306 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0eb699f4-8d58-42bf-855a-4b631dc1ef59 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.900823 May 13 21:52:10.304461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 42/79] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:09 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:10.314330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:10.319936 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:10.320779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:10.321233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:10.447579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:10.469583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7c9ee5dc-f4f3-4c56-8cb0-7541a982021b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1280 microversion: 2.1 time: 0.194309 May 13 21:52:10.473044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 38/80] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:10 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:11.286170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:11.287466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:11.297561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.299302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:11.301152 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.333775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:11.339177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:11.340469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:11.378094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.384176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:11.386361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.389817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:11.936384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:11.951729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-df839ced-bb2d-4d99-9f12-6509dc382a56 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.667733 May 13 21:52:11.953301 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 43/81] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:11 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:11.959726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:11.960651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:11.971304 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.971801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:11.972837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:11.974267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:12.014556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:12.022605 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:12.024164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:12.025871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-11aefff6-edbd-44e1-b125-a6bcafefd5a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.708973 May 13 21:52:12.039700 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 39/82] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:11 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:52:12.234651 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-8a4cb235-9e9b-43c3-bb08-a8a971b73cad req-090a15d4-8008-4e05-9bee-e148cf8c137d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:12.244547 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8a4cb235-9e9b-43c3-bb08-a8a971b73cad req-090a15d4-8008-4e05-9bee-e148cf8c137d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:12.245203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8a4cb235-9e9b-43c3-bb08-a8a971b73cad req-090a15d4-8008-4e05-9bee-e148cf8c137d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:12.258086 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-8a4cb235-9e9b-43c3-bb08-a8a971b73cad req-090a15d4-8008-4e05-9bee-e148cf8c137d service nova] Creating event network-changed:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:52:12.263902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-8a4cb235-9e9b-43c3-bb08-a8a971b73cad req-090a15d4-8008-4e05-9bee-e148cf8c137d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222357 May 13 21:52:12.264508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 40/83] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:12.509578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-3283610d-1b22-488f-94e8-f4beb551068f req-bd895393-205c-472a-994b-53c04d8da94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f3e7ea-df2f-4358-a44c-ea4e9520b05c", "tag": "c3aa6bb9-4ce2-4adf-953e-16d164392134"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:12.517259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:12.521487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-3283610d-1b22-488f-94e8-f4beb551068f req-bd895393-205c-472a-994b-53c04d8da94e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:12.521922 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-3283610d-1b22-488f-94e8-f4beb551068f req-bd895393-205c-472a-994b-53c04d8da94e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:12.538481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8b6efbba-8ef1-4dad-8783-cbc8c5a8fb3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.583798 May 13 21:52:12.542754 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 44/84] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:11 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:12.547899 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-3283610d-1b22-488f-94e8-f4beb551068f req-bd895393-205c-472a-994b-53c04d8da94e service nova] Creating event network-changed:c3aa6bb9-4ce2-4adf-953e-16d164392134 for instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c on hv-cinder-84051 May 13 21:52:12.553054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-3283610d-1b22-488f-94e8-f4beb551068f req-bd895393-205c-472a-994b-53c04d8da94e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047435 May 13 21:52:12.553999 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 41/85] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:52:12.979721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:12.982465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:13.007745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.008347 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.012312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.013469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.055772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:13.057606 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:13.069291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.070924 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.072793 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.073436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.472403 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:13.479599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ca4b8964-98f0-439b-b000-569f80b93e8c tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1315 microversion: 2.1 time: 0.511191 May 13 21:52:13.480179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 45/86] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:12 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:13.492184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:13.500840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:13.508153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:13.509499 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-12ba2c21-5671-4500-8342-aa37a6c5286d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.460232 May 13 21:52:13.523056 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 42/87] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:13 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:13.561410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:13.562050 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:13.569505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.570221 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.571242 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:13.571691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:13.745511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:13.752937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-966b9cc7-6a3c-47c6-af48-2a153c8ed210 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.197327 May 13 21:52:13.753834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 46/88] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:13 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:14.497775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:14.498442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:14.507780 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:14.508233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:14.509013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:14.509452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:14.527058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:14.527665 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:14.533934 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:14.534600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:14.536164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:14.539489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:15.230165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:15.241770 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:15.244519 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:15.246758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b0c1a56e-07cb-49e1-a7af-b85f767d34e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.723541 May 13 21:52:15.250726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 47/89] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:14 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:15.263026 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-ee87477e-fa8d-438f-8116-bc9a40efa085 req-90d3611a-2f07-4681-9a1c-bd3925f084a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fde36f-b050-42de-b5cb-b2914bc8f572", "tag": "e3fd2642-2b5f-482d-a83d-cd9af96786c4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:15.270030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-ee87477e-fa8d-438f-8116-bc9a40efa085 req-90d3611a-2f07-4681-9a1c-bd3925f084a1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:15.270482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-ee87477e-fa8d-438f-8116-bc9a40efa085 req-90d3611a-2f07-4681-9a1c-bd3925f084a1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:15.284649 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:15.290493 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-ee87477e-fa8d-438f-8116-bc9a40efa085 req-90d3611a-2f07-4681-9a1c-bd3925f084a1 service nova] Creating event network-changed:e3fd2642-2b5f-482d-a83d-cd9af96786c4 for instance 91fde36f-b050-42de-b5cb-b2914bc8f572 on hv-cinder-84051 May 13 21:52:15.293633 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1646f76c-b53c-4c72-a0e1-6c61fcf8cd52 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1502 microversion: 2.1 time: 0.800223 May 13 21:52:15.299701 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-ee87477e-fa8d-438f-8116-bc9a40efa085 req-90d3611a-2f07-4681-9a1c-bd3925f084a1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046852 May 13 21:52:15.300493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 43/90] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:14 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1502 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:15.305332 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:15.315580 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:15.317465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 48/91] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:15.330222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:15.333816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:15.337421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:15.338144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:15.641904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:15.650034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-36acda45-a41a-409e-89e0-28946cf15d21 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.348231 May 13 21:52:15.651791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 44/92] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:15 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:16.268081 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:16.268930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:16.282057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.284645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:16.285546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.285993 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:16.656437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:16.670858 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:16.671952 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:16.682856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.684972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:16.685400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:16.688498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.689229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:16.689775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:16.693469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4558b5ae-9ea7-4e76-adf7-88c92b4498fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.431415 May 13 21:52:16.695376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 49/93] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:16 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:16.904150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:16.908657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26cb218e-0ab4-4bea-b82b-d3154ffababb"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:16.909866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:16.911935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5e08deaf-7bd7-49e5-ae5d-7f712ced15f2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.246992 May 13 21:52:16.912562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 45/94] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:16 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:16.924039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.926689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:16.927591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:16.928868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:17.008362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-aa79d7d8-81e8-431b-8f00-343bb13eb0fd req-8b224971-076b-4685-b329-c7032b141334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "name": "network-vif-plugged", "status": "completed", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:17.018357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-aa79d7d8-81e8-431b-8f00-343bb13eb0fd req-8b224971-076b-4685-b329-c7032b141334 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:17.018993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-aa79d7d8-81e8-431b-8f00-343bb13eb0fd req-8b224971-076b-4685-b329-c7032b141334 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:17.042343 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-aa79d7d8-81e8-431b-8f00-343bb13eb0fd req-8b224971-076b-4685-b329-c7032b141334 service nova] Creating event network-vif-plugged:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:52:17.050007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-aa79d7d8-81e8-431b-8f00-343bb13eb0fd req-8b224971-076b-4685-b329-c7032b141334 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055047 May 13 21:52:17.051681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 46/95] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:52:17.713275 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:17.714012 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:17.727459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:17.729456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:17.730350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:17.732080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:17.891813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a46ef5bc-c029-4035-8b28-454273ef67a2 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "POST /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986898 May 13 21:52:17.893615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 50/96] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:52:16 2022] POST /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:17.936128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:17.936859 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:17.951174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:17.951640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:17.952515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:17.953165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:18.150630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:18.175730 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:18.177615 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:18.179037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-474eca88-12a6-4c53-b428-cb187403dcaa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1406 microversion: 2.20 time: 0.471014 May 13 21:52:18.179973 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 47/97] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:17 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:18.225666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:18.233699 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ffb4da42-27a3-4b0d-a16c-2743d085f7b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.307831 May 13 21:52:18.243259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 51/98] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:17 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:19.199131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:19.201270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:19.212490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.213038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.214762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.216870 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.250900 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:19.252104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:19.266494 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.267678 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.269686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.271024 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.509002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:19.519586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ea84e80e-c414-4094-93e2-bd8b2b3b32af tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.273549 May 13 21:52:19.520673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 52/99] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:19 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:19.532115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:19.540796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:19.546568 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:19.547812 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9414660b-328d-4b90-9c0f-189570f06d01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1597 microversion: 2.20 time: 0.353862 May 13 21:52:19.551528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 48/100] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:52:19 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1597 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:52:19.569337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:19.573826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:19.582468 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.583313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.584351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:19.585449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:19.699414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ceb305d4-756d-4586-af6b-de416ccfe40d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135952 May 13 21:52:19.700187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 53/101] 10.222.0.35 () {60 vars in 1315 bytes} [Fri May 13 21:52:19 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 21:52:20.537445 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:20.539354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:20.546855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:20.547468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:20.548392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:20.549289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:20.909919 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:20.917218 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3f18abf0-95ac-42b1-b3e4-1b6cd14492e8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.384519 May 13 21:52:20.925681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 49/102] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:20 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:21.517909 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-3d662571-1cac-4068-8942-ed458bd903bc req-a4751d50-7348-4054-bb01-b2d6cdcc29cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3e7ea-df2f-4358-a44c-ea4e9520b05c", "name": "network-vif-plugged", "status": "completed", "tag": "c3aa6bb9-4ce2-4adf-953e-16d164392134"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:21.550480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-3d662571-1cac-4068-8942-ed458bd903bc req-a4751d50-7348-4054-bb01-b2d6cdcc29cf service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:21.554387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-3d662571-1cac-4068-8942-ed458bd903bc req-a4751d50-7348-4054-bb01-b2d6cdcc29cf service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:21.582855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-3d662571-1cac-4068-8942-ed458bd903bc req-a4751d50-7348-4054-bb01-b2d6cdcc29cf service nova] Creating event network-vif-plugged:c3aa6bb9-4ce2-4adf-953e-16d164392134 for instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c on hv-cinder-84051 May 13 21:52:21.589978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-3d662571-1cac-4068-8942-ed458bd903bc req-a4751d50-7348-4054-bb01-b2d6cdcc29cf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075918 May 13 21:52:21.591782 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 54/103] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:21.936833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:21.937347 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:21.945811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:21.946266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:21.947142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:21.947517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:22.482172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:22.491353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-022b7f06-075b-4189-8985-c940a6f58db5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.559590 May 13 21:52:22.495091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 50/104] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:21 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:22.500324 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-404f4695-ce41-4844-ae89-7836fc384bc7 req-9ab95f59-4ac7-40c3-8f92-435686ece867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:22.509794 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-404f4695-ce41-4844-ae89-7836fc384bc7 req-9ab95f59-4ac7-40c3-8f92-435686ece867 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:22.510897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-404f4695-ce41-4844-ae89-7836fc384bc7 req-9ab95f59-4ac7-40c3-8f92-435686ece867 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:22.523595 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-404f4695-ce41-4844-ae89-7836fc384bc7 req-9ab95f59-4ac7-40c3-8f92-435686ece867 service nova] Creating event network-changed:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:52:22.530178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-404f4695-ce41-4844-ae89-7836fc384bc7 req-9ab95f59-4ac7-40c3-8f92-435686ece867 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 May 13 21:52:22.531519 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 55/105] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:52:23.522141 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:23.522938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:23.531374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:23.533188 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:23.536140 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:23.538152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:23.815044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:23.822524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-bc1726a7-5ff3-442c-98ce-1cbf5518f61f req-ce146e1b-4578-4118-af2f-d4cf47be38f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fde36f-b050-42de-b5cb-b2914bc8f572", "name": "network-vif-plugged", "status": "completed", "tag": "e3fd2642-2b5f-482d-a83d-cd9af96786c4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:23.828228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7dd589af-796a-435d-bb67-a04a49ff5cf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.310754 May 13 21:52:23.831654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 51/106] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:23 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:23.844901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-bc1726a7-5ff3-442c-98ce-1cbf5518f61f req-ce146e1b-4578-4118-af2f-d4cf47be38f1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:23.845535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-bc1726a7-5ff3-442c-98ce-1cbf5518f61f req-ce146e1b-4578-4118-af2f-d4cf47be38f1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:23.863449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-bc1726a7-5ff3-442c-98ce-1cbf5518f61f req-ce146e1b-4578-4118-af2f-d4cf47be38f1 service nova] Creating event network-vif-plugged:e3fd2642-2b5f-482d-a83d-cd9af96786c4 for instance 91fde36f-b050-42de-b5cb-b2914bc8f572 on hv-cinder-84051 May 13 21:52:23.870974 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-bc1726a7-5ff3-442c-98ce-1cbf5518f61f req-ce146e1b-4578-4118-af2f-d4cf47be38f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061738 May 13 21:52:23.871839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 56/107] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:52:24.847913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:24.849248 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:24.856756 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:24.857479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:24.858435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:24.859071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:25.080161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:25.093310 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5ef5340e-f69d-4c79-bbf5-79e977e1680a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.249085 May 13 21:52:25.094085 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 52/108] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:24 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:26.111654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:26.112963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:26.123402 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:26.123964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:26.124991 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:26.125874 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:26.286740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:26.295844 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d0f23711-9804-4675-bcc3-1d4cf68b7331 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.190231 May 13 21:52:26.296437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 57/109] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:26 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:27.312589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:27.313895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:27.321872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:27.322910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:27.324058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:27.325256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:27.520066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:27.528752 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c81db5b0-f953-4d55-ae82-ca5cee7eaa3b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.219545 May 13 21:52:27.530493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 53/110] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:27 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:28.546899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:28.547512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:28.556625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:28.557258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:28.558200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:28.558833 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:28.718563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:28.725803 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b5c5ade3-054e-462b-b5a6-3e1417b9af71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.183331 May 13 21:52:28.726392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 58/111] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:28 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:29.743568 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:29.744101 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:29.750017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:29.750463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:29.751257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:29.751692 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:29.878016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:29.885182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3221e0a7-b69f-4286-9a75-e7d73bdab567 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.145767 May 13 21:52:29.885751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 54/112] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:29 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:30.900940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:30.901470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:30.907791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:30.908245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:30.909008 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:30.909446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:31.043441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:31.051348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0486c9f2-92ed-4cd0-aa6e-227c7e999aec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.154391 May 13 21:52:31.052043 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 59/113] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:30 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:32.068863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:32.069457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:32.075796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:32.077194 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:32.078057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:32.078531 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:32.219914 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:32.228284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-28db097f-7dbb-4123-8a30-e469400b23cf tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.163099 May 13 21:52:32.230978 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 55/114] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:32 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:33.245110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:33.245823 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:33.252641 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:33.253088 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:33.253842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:33.254273 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:33.382204 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:33.389299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b37f9752-3f3b-48d5-bee0-b5fb9df121d4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.147978 May 13 21:52:33.389880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 60/115] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:33 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:34.405352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:34.405973 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:34.411832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:34.412276 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:34.413031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:34.413467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:34.537981 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:34.545604 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-919dea79-3713-4e96-9346-f69f8e7a36a0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.143513 May 13 21:52:34.546162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 56/116] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:34 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:35.401424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:35.401907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:35.408735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.409181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.409937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.410363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.435443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:52:35.520421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2d8b7254-fa70-4155-bb5d-67ca570af53a tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 204 len: 0 microversion: 2.1 time: 0.122470 May 13 21:52:35.521008 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 61/117] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:52:35 2022] DELETE /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:52:35.529852 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:35.530445 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:35.536467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.536909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.537672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.538100 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.561851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:35.562637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:35.571865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.571865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.571865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:35.571865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:35.716678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:35.725061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3511b0b1-4c54-4e70-b1f7-f08e89015363 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1554 microversion: 2.1 time: 0.199817 May 13 21:52:35.725638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 57/118] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:35 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:35.742419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:35.750584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-57ab9261-c891-4627-af14-db6b0bdfa1a3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1322 microversion: 2.1 time: 0.192837 May 13 21:52:35.751280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 62/119] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:35 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:36.742499 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:36.743194 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:36.749714 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:36.750163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:36.750952 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:36.751393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:36.768657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:36.770432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:36.777354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:36.778015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:36.778764 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:36.779298 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:36.959176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:36.967928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-59605536-d8e1-47e4-a50b-fe016f6d6d92 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1554 microversion: 2.1 time: 0.229437 May 13 21:52:36.968997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 58/120] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:36 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:36.970964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:36.978335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-926c3f03-133e-4d06-8344-1b59c0823d2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1515 microversion: 2.1 time: 0.215093 May 13 21:52:36.978920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 63/121] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:36 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:36.996233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:36.997443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:37.003910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.004360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:37.005129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.005565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:37.066252 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lazy-loading 'flavor' on Instance uuid 91fde36f-b050-42de-b5cb-b2914bc8f572 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:52:37.200259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8a48d134-d68f-4abb-8677-a98e2a43c128 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572/action" status: 200 len: 32 microversion: 2.1 time: 0.207570 May 13 21:52:37.201088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 59/122] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:52:36 2022] POST /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 21:52:37.211688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:37.212307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:37.223882 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.224339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:37.225115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.225553 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:37.366168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:37.374174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ab4dd641-8e18-4cc5-b7bc-2e8cd16ef1f8 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.167439 May 13 21:52:37.374800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 64/123] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:37 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:37.986017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:37.987574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:37.994927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.995383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:37.996161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:37.996609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:38.175014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:38.183109 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-18227982-e96c-4784-9300-d474a18c89db tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1554 microversion: 2.1 time: 0.201398 May 13 21:52:38.186783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 60/124] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:37 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:38.391284 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:38.391895 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:38.399149 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:38.399650 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:38.400380 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:38.401028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:38.926935 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:38.934694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-761d2c5d-bbad-473a-9744-cbbffc2ded78 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.547283 May 13 21:52:38.935273 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 65/125] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:38 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:39.202398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:39.203033 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:39.217304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:39.217304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:39.217304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:39.220019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:39.305292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-48b917d1-bc19-4544-8834-a8b885e69529 req-9983550e-d5ec-4ab7-9e16-4b7885c1401e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc", "name": "network-vif-deleted", "tag": "33b2d378-1acb-4b8e-945a-43a9d123744b"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:39.325140 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:39.331627 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-48b917d1-bc19-4544-8834-a8b885e69529 req-9983550e-d5ec-4ab7-9e16-4b7885c1401e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:39.333027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-48b917d1-bc19-4544-8834-a8b885e69529 req-9983550e-d5ec-4ab7-9e16-4b7885c1401e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:39.334948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-df76863c-8c2b-452e-992c-806d541d11d9 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1512 microversion: 2.1 time: 0.137561 May 13 21:52:39.346144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 61/126] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:39 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:39.354145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-48b917d1-bc19-4544-8834-a8b885e69529 req-9983550e-d5ec-4ab7-9e16-4b7885c1401e service nova] Creating event network-vif-deleted:33b2d378-1acb-4b8e-945a-43a9d123744b for instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc on hv-cinder-84051 May 13 21:52:39.361607 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-48b917d1-bc19-4544-8834-a8b885e69529 req-9983550e-d5ec-4ab7-9e16-4b7885c1401e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060941 May 13 21:52:39.366544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 66/127] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:52:39.952133 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:39.952841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:39.959092 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:39.960309 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:39.961259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:39.961691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:40.137586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:40.148861 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2b9d113b-23dc-4306-81a3-fa252239d356 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.200905 May 13 21:52:40.149913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 62/128] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:39 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:40.355167 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:40.356997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:40.368705 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:40.369508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:40.370585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:40.388376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:40.480738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:40.481393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:40.484797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lazy-loading 'fault' on Instance uuid 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:52:40.550306 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1315f98467d8426094229e3a31c618f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39174f764455497c99b2fc47838407f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:40.559699 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9fdc6b0c-a0f0-4cd8-ace8-e076d937e260 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 200 len: 1305 microversion: 2.1 time: 0.210118 May 13 21:52:40.560247 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 67/129] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:40 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:41.170872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:41.173444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:41.183680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.184384 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.185942 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.186446 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.330286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:41.341026 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-28a8e243-2c65-4aca-82f3-13e2d396b146 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.177388 May 13 21:52:41.341618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 63/130] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:41 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:41.578153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:41.578153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:41.588067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.590061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.591938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.592807 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.610418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] HTTP exception thrown: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Request method failure captured: May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc HTTP/1.1 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftLpvcW4NuyO67BzBEk4RXMQlYSmNuRto5RfinagtkVvBrnk_YeK_kWRPC7FsPsCE18UG62rao9RYkuzqzKXZufYP1dkv6wryNwPj9SlfmdadKyr7o3Syf5ZjMcIGELip7g65eb73RBaggCsJEgRYAg3UMd-Xa66GIX41pI_cPRFDyA May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:52:41.627915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_39174f764455497c99b2fc47838407f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/39174f764455497c99b2fc47838407f8"}]}] May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 1315f98467d8426094229e3a31c618f3 May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.629209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc'} May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:41.630752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.632365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:41.634367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Returning 404 to user: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:41.634367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e3784685-2ea9-45ec-b325-8eefec8009b1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 404 len: 111 microversion: 2.1 time: 0.055997 May 13 21:52:41.634367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 68/131] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:41 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:52:41.765605 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:41.766642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:41.778203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.778894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.780209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:41.782495 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:41.797200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] HTTP exception thrown: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Request method failure captured: May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc/os-volume_attachments HTTP/1.1 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftLpvcW4NuyO67BzBEk4RXMQlYSmNuRto5RfinagtkVvBrnk_YeK_kWRPC7FsPsCE18UG62rao9RYkuzqzKXZufYP1dkv6wryNwPj9SlfmdadKyr7o3Syf5ZjMcIGELip7g65eb73RBaggCsJEgRYAg3UMd-Xa66GIX41pI_cPRFDyA May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:41.801573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_39174f764455497c99b2fc47838407f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/39174f764455497c99b2fc47838407f8"}]}] May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 1315f98467d8426094229e3a31c618f3 May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.803088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'server_id': '4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc'} May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:41.804246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:41.805307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:41.807510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Returning 404 to user: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:41.808470 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bdcbae0e-d1f4-4ba7-b427-6b15fdaf4f0e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047079 May 13 21:52:41.809449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 64/132] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:52:41 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:52:42.358139 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:42.359272 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:42.365942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:42.366834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:42.367765 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:42.368421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:42.651691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:42.661572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4fa5ed9d-43d8-49f1-8069-e31c6fffa30f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.307808 May 13 21:52:42.663801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 69/133] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:42 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:43.683688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:43.685690 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:43.705954 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:43.707703 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:43.708892 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:43.710789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:44.107104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:44.122598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-625626ea-7c16-4d00-9884-6b5d36cc9f11 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.446564 May 13 21:52:44.123617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 65/134] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:43 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:44.274778 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:44.276930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:44.293137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:44.296313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:44.299144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:44.300042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:44.323885 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] HTTP exception thrown: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Request method failure captured: May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc HTTP/1.1 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftLpvcW4NuyO67BzBEk4RXMQlYSmNuRto5RfinagtkVvBrnk_YeK_kWRPC7FsPsCE18UG62rao9RYkuzqzKXZufYP1dkv6wryNwPj9SlfmdadKyr7o3Syf5ZjMcIGELip7g65eb73RBaggCsJEgRYAg3UMd-Xa66GIX41pI_cPRFDyA May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:52:44.326308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_39174f764455497c99b2fc47838407f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/39174f764455497c99b2fc47838407f8"}]}] May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 1315f98467d8426094229e3a31c618f3 May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.327690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc'} May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:44.328479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.329834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:44.336199 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Returning 404 to user: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:44.337448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-23c0aa05-954a-493e-a0b6-cd509b64d0e1 tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 404 len: 111 microversion: 2.1 time: 0.068112 May 13 21:52:44.338603 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 70/135] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:52:44 2022] DELETE /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:52:44.349870 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:44.351796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] [instance: 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:44.360005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:44.362523 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:44.363952 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:44.364617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] HTTP exception thrown: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Request method failure captured: May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc HTTP/1.1 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftLpvcW4NuyO67BzBEk4RXMQlYSmNuRto5RfinagtkVvBrnk_YeK_kWRPC7FsPsCE18UG62rao9RYkuzqzKXZufYP1dkv6wryNwPj9SlfmdadKyr7o3Syf5ZjMcIGELip7g65eb73RBaggCsJEgRYAg3UMd-Xa66GIX41pI_cPRFDyA May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:44.408971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/39174f764455497c99b2fc47838407f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_39174f764455497c99b2fc47838407f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/39174f764455497c99b2fc47838407f8"}]}] May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 39174f764455497c99b2fc47838407f8 May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-DeleteServersTestJSON-1996890716 May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 1315f98467d8426094229e3a31c618f3 May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-DeleteServersTestJSON-1996890716-project May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.410896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc'} May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:44.411813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. May 13 21:52:44.413284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:44.414530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] Returning 404 to user: Instance 4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:44.414530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-eb93b3c0-102d-43fd-ad97-8de33bc61f4e tempest-DeleteServersTestJSON-1996890716 tempest-DeleteServersTestJSON-1996890716-project] 10.222.0.35 "GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc" status: 404 len: 111 microversion: 2.1 time: 0.062570 May 13 21:52:44.414530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 66/136] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:44 2022] GET /compute/v2.1/servers/4ae59ebe-ec5e-4d1e-80f0-ec009e1dabfc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 21:52:45.124901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1766883214", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "networks": [{"uuid": "8fdb1b48-8d7a-41bf-9d07-073be7f93649"}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:45.142044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:45.143598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:45.152537 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:45.152904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:45.159731 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:45.160400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:45.236440 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] validate_networks() for [('8fdb1b48-8d7a-41bf-9d07-073be7f93649', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:52:45.907221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:45.929369 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d4af34a5-5108-478d-8208-3edc1afce044 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.792240 May 13 21:52:45.930761 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 67/137] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:45 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:46.515119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:52:46.517251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:52:46.517805 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:52:46.518361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:52:46.519733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:52:46.534823 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:46.535501 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:46.536491 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:46.537128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:46.586838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Getting quotas for project 1aef84932f4f4725bbc4095f07ebf56e. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:52:46.594351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Getting quotas for user 004034ab6aca41ae893214bf0e81841b and project 1aef84932f4f4725bbc4095f07ebf56e. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:52:46.618501 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:52:46.627806 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:52:46.756978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2068d34a-80e6-4501-af74-4c6e8cf923b8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644909 May 13 21:52:46.760362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 71/138] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:52:46.769101 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-750e12b0-6371-4470-819c-6df9c4535b73 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:46.770765 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-750e12b0-6371-4470-819c-6df9c4535b73 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:46.948368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:46.950828 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:46.959481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:46.960358 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:46.961365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:46.962585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:47.129421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-750e12b0-6371-4470-819c-6df9c4535b73 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:47.139672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-750e12b0-6371-4470-819c-6df9c4535b73 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1214 microversion: 2.1 time: 0.372226 May 13 21:52:47.140488 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 68/139] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:46 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:47.372290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:47.381897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2c3d3ac5-e9bc-4bb4-bede-734eba42e02f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.438571 May 13 21:52:47.385067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 72/140] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:46 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:48.012790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-427b2fa7-6f5b-4f4c-a762-1cb07471535f tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Action: 'create', calling method: .version_select at 0x7fb7dc050700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459028926", "metadata": {"Type": "work"}}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-427b2fa7-6f5b-4f4c-a762-1cb07471535f tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 122 May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:48.023344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459028926", "metadata": {"Type": "work"}}} May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:52:48.024594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1459028926', 'metadata': {'Type': 'work'}}}} May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise error May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi '#$%' May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.025300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 21:52:48.026431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 21:52:48.027881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 21:52:48.027881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.029714 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-427b2fa7-6f5b-4f4c-a762-1cb07471535f tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.030796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-427b2fa7-6f5b-4f4c-a762-1cb07471535f tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.395783 May 13 21:52:48.033183 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 69/141] 10.222.0.35 () {60 vars in 1155 bytes} [Fri May 13 21:52:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 21:52:48.043795 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-40bcdcd9-6918-4b6f-8fe5-7f37472d2d73 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Action: 'create', calling method: .version_select at 0x7fb7d67a1160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1858733981", "metadata": {"Type": "work"}}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-40bcdcd9-6918-4b6f-8fe5-7f37472d2d73 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 120 May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:52:48.047896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1858733981", "metadata": {"Type": "work"}}} May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: May 13 21:52:48.049442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1858733981', 'metadata': {'Type': 'work'}}}} May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise error May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi '0' May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.050379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 21:52:48.051854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 21:52:48.053091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 21:52:48.053091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.053091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-40bcdcd9-6918-4b6f-8fe5-7f37472d2d73 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.055114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-40bcdcd9-6918-4b6f-8fe5-7f37472d2d73 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014199 May 13 21:52:48.055114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 73/142] 10.222.0.35 () {60 vars in 1155 bytes} [Fri May 13 21:52:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 21:52:48.066018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bcb5c17b-743a-4c3c-90ac-cdf5f4ada757 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Action: 'create', calling method: .version_select at 0x7fb7d7794160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-188663571", "metadata": {"Type": "work"}}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bcb5c17b-743a-4c3c-90ac-cdf5f4ada757 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 118 May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:48.072360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-188663571", "metadata": {"Type": "work"}}} May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:52:48.073777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-188663571', 'metadata': {'Type': 'work'}}}} May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise error May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi '' May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.074468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 21:52:48.075683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 21:52:48.076668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 21:52:48.076668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.076668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bcb5c17b-743a-4c3c-90ac-cdf5f4ada757 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.076668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bcb5c17b-743a-4c3c-90ac-cdf5f4ada757 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014070 May 13 21:52:48.076668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 70/143] 10.222.0.35 () {60 vars in 1155 bytes} [Fri May 13 21:52:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 21:52:48.088169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6b66aa56-9708-4f67-ab94-671e328e7d91 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Calling method '.version_select at 0x7fb7d6783430>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:48.140909 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-6b66aa56-9708-4f67-ab94-671e328e7d91 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] HTTP exception thrown: Volume tempest-invalid-162050823 could not be found. May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6b66aa56-9708-4f67-ab94-671e328e7d91 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-162050823 HTTP/1.1 May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:52:48.142904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Volume tempest-invalid-162050823 could not be found. May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'tempest-invalid-162050823'} May 13 21:52:48.144289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-162050823 could not be found. (HTTP 404) (Request-ID: req-7a8a6510-f093-475e-8313-22c1607082cd) May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.145071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:52:48.146106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-162050823 could not be found. May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:48.147194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-162050823 could not be found. May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-162050823 could not be found. May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6b66aa56-9708-4f67-ab94-671e328e7d91 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 404 to user: Volume tempest-invalid-162050823 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6b66aa56-9708-4f67-ab94-671e328e7d91 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-162050823" status: 404 len: 98 microversion: 2.1 time: 0.062808 May 13 21:52:48.148248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 74/144] 10.222.0.35 () {58 vars in 1214 bytes} [Fri May 13 21:52:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-162050823 => generated 98 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 21:52:48.156366 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b8df5a0b-b125-4ff5-94d6-ad0ca0829933 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005882 May 13 21:52:48.156895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 71/145] 10.222.0.35 () {58 vars in 1139 bytes} [Fri May 13 21:52:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 21:52:48.162738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:48.163534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:48.168320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-21dd53b9-8a48-41f9-9b6f-16b0760de22f tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003922 May 13 21:52:48.168320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 72/146] 10.222.0.35 () {58 vars in 1136 bytes} [Fri May 13 21:52:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 13 21:52:48.175998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2a1b5a23-665c-4dad-970a-df78a2196ec7 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Calling method '.version_select at 0x7fb7dcf68820>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:48.182135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:48.183139 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:48.204876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:48.205466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:48.231059 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-2a1b5a23-665c-4dad-970a-df78a2196ec7 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] HTTP exception thrown: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2a1b5a23-665c-4dad-970a-df78a2196ec7 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/os-volumes/993f1b3f-2698-4a8a-8c06-a33a952cd1b9 HTTP/1.1 May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:48.234037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '993f1b3f-2698-4a8a-8c06-a33a952cd1b9'} May 13 21:52:48.235357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. (HTTP 404) (Request-ID: req-b07147a1-859b-46f0-908f-e54e540985e6) May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.236168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 21:52:48.237493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 21:52:48.238764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2a1b5a23-665c-4dad-970a-df78a2196ec7 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 404 to user: Volume 993f1b3f-2698-4a8a-8c06-a33a952cd1b9 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2a1b5a23-665c-4dad-970a-df78a2196ec7 tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/993f1b3f-2698-4a8a-8c06-a33a952cd1b9" status: 404 len: 109 microversion: 2.1 time: 0.063544 May 13 21:52:48.239918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 73/147] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:52:48 2022] DELETE /compute/v2.1/os-volumes/993f1b3f-2698-4a8a-8c06-a33a952cd1b9 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:52:48.248843 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e0e9c01-afe2-446e-8a19-6f78f03497af tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Calling method '.version_select at 0x7fb7dc1ae700>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:48.303781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:48.325513 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9fc670f3-4c76-4426-92d7-c0cad1038fca tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1266 microversion: 2.1 time: 0.160691 May 13 21:52:48.326542 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 75/148] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:48 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:48.332089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-8e0e9c01-afe2-446e-8a19-6f78f03497af tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] HTTP exception thrown: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e0e9c01-afe2-446e-8a19-6f78f03497af tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Request method failure captured: May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/os-volumes/91396d3e-7965-413f-868b-c762881dd6fc HTTP/1.1 May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvO6QFyqNOVkI5uG7N-zG28SDO7-R62lkmVAo-zqCprV1Q3zBcABYJ783xR-IVDmT8rRbOag_j4pFErC8q8EJXH4C-D1IcZRGKziGAhB2GCVsx6Epsqnz24x-wksPzg1NbQ5CErTGHRd9tkoRjUcRQcR6KCDk0O-jUg5KQLz0PBIk May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:52:48.334327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_c0e44b87f674490a9d95d2ae148a0e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/c0e44b87f674490a9d95d2ae148a0e1a"}]}] May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: c0e44b87f674490a9d95d2ae148a0e1a May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesNegativeTest-1337465870 May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: f82a1348def44e7d8978431779cf360c May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesNegativeTest-1337465870-project May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '91396d3e-7965-413f-868b-c762881dd6fc'} May 13 21:52:48.335717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. (HTTP 404) (Request-ID: req-cd5d1251-f0ca-4f37-9ad8-74cc91f5b8f9) May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.336557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 21:52:48.337684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 21:52:48.338656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e0e9c01-afe2-446e-8a19-6f78f03497af tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] Returning 404 to user: Volume 91396d3e-7965-413f-868b-c762881dd6fc could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8e0e9c01-afe2-446e-8a19-6f78f03497af tempest-VolumesNegativeTest-1337465870 tempest-VolumesNegativeTest-1337465870-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/91396d3e-7965-413f-868b-c762881dd6fc" status: 404 len: 109 microversion: 2.1 time: 0.094833 May 13 21:52:48.343989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 74/149] 10.222.0.35 () {58 vars in 1244 bytes} [Fri May 13 21:52:48 2022] GET /compute/v2.1/os-volumes/91396d3e-7965-413f-868b-c762881dd6fc => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:52:48.402082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:48.402746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:48.412765 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:48.413215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:48.413995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:48.414426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:49.002000 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:49.018106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-53aacb10-7e0a-41fe-900c-823f3c1f60ec tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.618457 May 13 21:52:49.019466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 76/150] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:48 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:49.344184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:49.345558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:49.355136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:49.356443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:49.358161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:49.358767 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:49.512458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:49.525576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c2345d45-bfee-4b90-933a-655a7d89b0c1 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1272 microversion: 2.1 time: 0.182483 May 13 21:52:49.526140 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 75/151] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:49 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:50.035230 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:50.036083 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:50.048464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:50.050737 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:50.051739 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:50.062409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:50.544243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:50.546679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:50.564984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:50.565145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:50.566761 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:50.569218 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:50.571675 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:50.577216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-aa243534-4e55-4ec7-a6ab-a9acf1c8a1b3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.545521 May 13 21:52:50.593070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 77/152] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:50 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:51.033628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:51.049533 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0990c69a-daf5-4c7e-9fba-6e376a8d0d98 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.509732 May 13 21:52:51.060656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 76/153] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:50 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:52:51.595247 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:51.595855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:51.616366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:51.618654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:51.620427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:51.621793 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:52.067770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:52.071159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:52.072244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:52.079011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:52.082518 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a94c5cf4-b270-4ca4-b6f6-5cfb04b71f13 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.489330 May 13 21:52:52.083931 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 78/154] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:51 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:52.087355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:52.090656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:52.091177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:52.931128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:52.941575 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7f103bfc-6584-4051-a767-be9bb2b740b2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.877800 May 13 21:52:52.954895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 77/155] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:52 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:53.103670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:53.104799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:53.128759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:53.129239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:53.130022 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:53.132169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:53.571392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:53.579134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7427a9a4-5784-40da-9ef6-e0ab6d6bd2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.483166 May 13 21:52:53.584599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 79/156] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:53 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:53.759824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-825266f2-4118-4242-83e8-9bff0ffb47b3 req-f47f3adf-4c69-46ff-973c-87e387b7d1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8353f81c-b932-4da9-89b4-82bf9883a3c9", "tag": "0a84daf6-7909-41e6-9df9-bfda090f53cf"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:52:53.775478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-825266f2-4118-4242-83e8-9bff0ffb47b3 req-f47f3adf-4c69-46ff-973c-87e387b7d1a2 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:53.775921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-825266f2-4118-4242-83e8-9bff0ffb47b3 req-f47f3adf-4c69-46ff-973c-87e387b7d1a2 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:53.808960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-825266f2-4118-4242-83e8-9bff0ffb47b3 req-f47f3adf-4c69-46ff-973c-87e387b7d1a2 service nova] Creating event network-changed:0a84daf6-7909-41e6-9df9-bfda090f53cf for instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 on hv-cinder-84051 May 13 21:52:53.827140 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-825266f2-4118-4242-83e8-9bff0ffb47b3 req-f47f3adf-4c69-46ff-973c-87e387b7d1a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071123 May 13 21:52:53.828338 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 78/157] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:52:53.962805 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:53.963399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:53.969987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:53.970410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:53.974536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:53.979941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:54.298582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:54.307555 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cc7c5437-d9bd-432d-89c2-d59a1312cfa5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.349934 May 13 21:52:54.310807 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 80/158] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:53 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:54.601546 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:54.602346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:54.617592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:54.618673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:54.620173 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:54.621577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:55.303241 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:55.313982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-90cda3c3-5b24-4987-926e-33f22fb6a067 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.716375 May 13 21:52:55.315216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 79/159] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:54 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:55.329546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:55.330195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:55.338615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:55.339469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:55.340470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:55.342033 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:55.588442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:55.600474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9d076153-f1de-4885-87e7-251bd7ec4ed3 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.274492 May 13 21:52:55.601516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 81/160] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:55 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:56.334398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:56.335066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:56.345097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:56.348241 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:56.351479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:56.351875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:56.618251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:56.620038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:56.645830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:56.648947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:56.650503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:56.651726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:56.745971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:56.759078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5a006dc2-4787-4908-a6ef-4ba35c4ad3ea tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.427575 May 13 21:52:56.759707 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 80/161] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:56 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:57.033641 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:57.042075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0fc71968-445e-4c10-ad33-512c50afb56f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.428367 May 13 21:52:57.052059 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 82/162] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:56 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:57.777340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:57.779126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:57.788508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:57.791114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:57.795055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:57.795542 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:58.058759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:58.060291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:58.095798 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:58.096399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:58.097244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:58.100199 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:58.651955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:58.665082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bfd7e0da-e092-4512-8dc2-79f0f4922c6c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.609684 May 13 21:52:58.674905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 83/163] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:58 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:58.704082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:52:58.711973 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3e5ac387-0e43-45ad-a662-493c57c949cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.940021 May 13 21:52:58.725086 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 81/164] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:57 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:52:59.682171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:59.682800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:59.701889 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:59.702632 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:59.715003 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:59.715638 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:59.730350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:52:59.732464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:52:59.746881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:59.747912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:52:59.754229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:52:59.754753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:00.274446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:00.293444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:00.308137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a54d4e6e-3eaa-45b5-98df-4716563b20e7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.624931 May 13 21:53:00.308774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 84/165] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:59 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:00.318853 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b8faa1d7-5f72-4a75-b119-381817c5fdb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.592056 May 13 21:53:00.319465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 82/166] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:52:59 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:00.341935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-e4ae5e83-b1ef-4f2b-aee9-352fd201e535 req-34765d54-19cc-46bc-be32-19fe7567a29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8353f81c-b932-4da9-89b4-82bf9883a3c9", "name": "network-vif-plugged", "status": "completed", "tag": "0a84daf6-7909-41e6-9df9-bfda090f53cf"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:00.361645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-e4ae5e83-b1ef-4f2b-aee9-352fd201e535 req-34765d54-19cc-46bc-be32-19fe7567a29d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:00.362273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-e4ae5e83-b1ef-4f2b-aee9-352fd201e535 req-34765d54-19cc-46bc-be32-19fe7567a29d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:00.378817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-e4ae5e83-b1ef-4f2b-aee9-352fd201e535 req-34765d54-19cc-46bc-be32-19fe7567a29d service nova] Creating event network-vif-plugged:0a84daf6-7909-41e6-9df9-bfda090f53cf for instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 on hv-cinder-84051 May 13 21:53:00.397146 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-e4ae5e83-b1ef-4f2b-aee9-352fd201e535 req-34765d54-19cc-46bc-be32-19fe7567a29d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048862 May 13 21:53:00.399059 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 83/167] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:00.641954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6d29f2de-b5b0-489f-8c0d-2ae85c11d9f0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Action: 'create', calling method: .version_select at 0x7fb7dc111f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-476909752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tOKk+ZrqYzSsNMzVMStdxdwsF5gjQWSR2l7irrvh0Yk8AZ+iwFym+mQKOsrsEYcfO0BsIMp8VVU0+Wavm3C/u2rGC5Ov9Zgr72GeYwmLeNraXSWwZU5GQ/H96Zb+jqw=="}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:00.665090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-6d29f2de-b5b0-489f-8c0d-2ae85c11d9f0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:53:00.675515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-6d29f2de-b5b0-489f-8c0d-2ae85c11d9f0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for user c3a0de9ca12746be893b97d3cd11b826 and project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:53:00.723754 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6d29f2de-b5b0-489f-8c0d-2ae85c11d9f0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.394434 May 13 21:53:00.726648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 85/168] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:53:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:01.326332 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:01.327055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:01.335547 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:01.336193 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:01.337170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:01.337794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:01.339907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:01.341480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:01.358756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:01.360705 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:01.361631 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:01.362079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:01.764729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:01.774980 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5bf8bae2-f794-41bd-a258-dd4fab37983e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1314 microversion: 2.1 time: 0.453217 May 13 21:53:01.775564 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 84/169] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:01 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:01.797580 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:01.809860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-43281789-3d90-4b54-9faf-dd7e7a78e298 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.477527 May 13 21:53:01.811094 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 86/170] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:01 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:02.795989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:02.796600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:02.806090 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:02.806540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:02.807345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:02.807778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:02.831337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:02.831955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:02.849722 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:02.850209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:02.851566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:02.852623 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:03.273584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:03.282237 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9aca951a-c776-46a8-88d8-dadc90ba7abb tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1499 microversion: 2.1 time: 0.490464 May 13 21:53:03.295430 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 85/171] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:02 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1499 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:03.357647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:03.375027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-06e6c86b-b835-45bc-b1e8-0fc2330b8fd7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.546884 May 13 21:53:03.375947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 87/172] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:02 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:04.391913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:04.392587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:04.402386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:04.404964 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:04.406441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:04.407626 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:04.575779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:04.584414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-022910e9-5f3e-4911-9ba2-7f0711a86e1c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.196315 May 13 21:53:04.585173 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 86/173] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:04 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:05.601182 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:05.602501 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:05.609400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:05.609849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:05.610608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:05.611091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:05.748359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:05.755806 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bce9c2b7-807e-4664-b0ab-e2f96f7076cc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.158400 May 13 21:53:05.756381 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 88/174] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:05 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:06.752474 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:06.753696 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:06.759939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.760439 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.761209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.761629 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.772756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:06.773363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:06.796118 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.796930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.798023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.798612 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.805688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:53:06.930423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0a6c85fd-1036-45ff-a7bf-42b7ba77fb7b tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 204 len: 0 microversion: 2.1 time: 0.181644 May 13 21:53:06.931586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 87/175] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:53:06 2022] DELETE /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:53:06.945930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:06.947010 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:06.955938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.957990 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.963679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:06.964332 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:06.988489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:06.997061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3c2d452e-ebd0-4d3f-9327-d9c4e2655e39 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.227929 May 13 21:53:06.998110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 89/176] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:06 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:07.149173 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:07.158262 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-da6a9cd5-1dc4-4df5-a758-f5a5fdc4e7cf tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.222205 May 13 21:53:07.162937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 88/177] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:06 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:07.179729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:07.180346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:07.188208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:07.188691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:07.189707 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:07.190189 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:07.218084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-02028a07-2377-4d38-8c4e-f57f3c121cdc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/ips" status: 200 len: 150 microversion: 2.20 time: 0.043001 May 13 21:53:07.218584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 90/178] 10.222.0.35 () {60 vars in 1288 bytes} [Fri May 13 21:53:07 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:53:08.014463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:08.015058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:08.020860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:08.021312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:08.022070 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:08.022503 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:08.145991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:08.153479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8781c959-0c03-49d8-98c1-09acae2a2f92 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.143482 May 13 21:53:08.154059 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 89/179] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:08 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:08.180852 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:08.181464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:08.188267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:08.188717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:08.189484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:08.189916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:08.322326 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:08.329563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-811b09e7-b9b3-4120-947d-bd2277193414 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.152525 May 13 21:53:08.330125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 91/180] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:08 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:09.169271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:09.169909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:09.175844 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:09.176293 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:09.177053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:09.177485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:09.304142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:09.311563 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-35058730-c924-4b0f-b290-b2b983a1406d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.146059 May 13 21:53:09.312120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 90/181] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:09 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:09.346831 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:09.347446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:09.353657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:09.354113 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:09.354908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:09.355351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:09.480502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:09.487666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e8ab80bf-afa9-435e-ad63-90e3dbeb8c3e tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.144638 May 13 21:53:09.488223 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 92/182] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:09 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:10.328393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:10.329005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:10.334818 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:10.335270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:10.336032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:10.336469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:10.504623 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:10.505371 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:10.511673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:10.512195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:10.512959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:10.513944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:10.661062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:10.668696 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-26eaecec-5233-4951-a62b-944e3d46cc71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.344195 May 13 21:53:10.669278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 91/183] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:10 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:10.689385 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:10.696759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2862e9bf-bfa6-4973-a56a-5cd38469cc79 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.195939 May 13 21:53:10.697359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 93/184] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:10 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:11.686250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:11.686913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:11.692685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:11.693131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:11.693890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:11.694361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:11.713143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:11.713749 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:11.720102 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:11.720553 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:11.721231 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:11.721664 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:11.889091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:11.896288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f65b7c6b-a7ab-41f9-993d-00114de35e71 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.214368 May 13 21:53:11.896849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 92/185] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:11 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:11.900456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:11.907731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-08513dd0-da68-4fc6-aaa3-fa33afbc8dfc tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.198276 May 13 21:53:11.908279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 94/186] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:11 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:12.912880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:12.913488 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:12.919619 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:12.920013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:12.920777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:12.921214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:12.924147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:12.924753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:12.930925 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:12.931368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:12.932120 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:12.932549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:13.125937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:13.129880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:13.133346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-56bfa8ad-222c-4253-bca3-afe48ed02b8f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.224299 May 13 21:53:13.133908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 93/187] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:12 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:13.137417 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-45279498-1ef2-4a55-8a6d-3c22ee4a9e85 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1505 microversion: 2.1 time: 0.216961 May 13 21:53:13.138563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 95/188] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:12 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:14.148380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-8837efb9-6a13-42bc-b61b-3bd86f4194d8 req-d00d590b-b3c2-4f5a-aea2-ad17a9247321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8353f81c-b932-4da9-89b4-82bf9883a3c9", "name": "network-vif-deleted", "tag": "0a84daf6-7909-41e6-9df9-bfda090f53cf"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:14.157619 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8837efb9-6a13-42bc-b61b-3bd86f4194d8 req-d00d590b-b3c2-4f5a-aea2-ad17a9247321 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:14.158057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8837efb9-6a13-42bc-b61b-3bd86f4194d8 req-d00d590b-b3c2-4f5a-aea2-ad17a9247321 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:14.159235 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:14.159970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:14.166432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:14.166964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:14.167828 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:14.168266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:14.169083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-8837efb9-6a13-42bc-b61b-3bd86f4194d8 req-d00d590b-b3c2-4f5a-aea2-ad17a9247321 service nova] Creating event network-vif-deleted:0a84daf6-7909-41e6-9df9-bfda090f53cf for instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 on hv-cinder-84051 May 13 21:53:14.174838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-8837efb9-6a13-42bc-b61b-3bd86f4194d8 req-d00d590b-b3c2-4f5a-aea2-ad17a9247321 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030025 May 13 21:53:14.175510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 94/189] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:14.180774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:14.181460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:14.187896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:14.188457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:14.189333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:14.189879 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:14.265178 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:14.272717 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5d7521d4-ed09-4794-8c85-52700c750575 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1463 microversion: 2.1 time: 0.096054 May 13 21:53:14.273557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 95/190] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:14 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1463 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:14.327111 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:14.334209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6232ad44-b323-4f6d-9c10-aa0035dd005a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.187546 May 13 21:53:14.334793 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 96/191] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:14 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:15.290007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:15.290761 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:15.297234 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.297713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.298482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.299129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.333422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.333875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.334323 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lazy-loading 'fault' on Instance uuid 8353f81c-b932-4da9-89b4-82bf9883a3c9 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:15.352509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:15.353178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:15.360239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.361537 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.362582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.363911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.387337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:15.397408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-114f8c64-6e9c-481b-9472-0121cc87f454 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1304 microversion: 2.1 time: 0.111290 May 13 21:53:15.398801 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 96/192] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:15 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:15.575390 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:15.583984 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a222effa-4488-4673-9b90-4222a0583320 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.235444 May 13 21:53:15.585062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 97/193] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:15 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:15.902511 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:15.903066 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:15.909523 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.909978 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.910772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:15.911216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:15.935482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lazy-loading 'flavor' on Instance uuid c1cdc615-a1e5-435d-95d3-f1187a00f7e0 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:16.198721 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ed2311bc-1616-492c-9dad-803204f545b2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/action" status: 202 len: 0 microversion: 2.20 time: 0.299993 May 13 21:53:16.199353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 97/194] 10.222.0.35 () {62 vars in 1318 bytes} [Fri May 13 21:53:15 2022] POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 21:53:16.207813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:16.208410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:16.214503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.214983 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.215753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.216719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.345645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:16.358004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:16.359562 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:16.360714 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bb74a860-66e4-4abb-825a-15ac3f03ab4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.156797 May 13 21:53:16.361271 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 98/195] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:16 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:16.415558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:16.416247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:16.422938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.423380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.424137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.424571 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.453978 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.454459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.454877 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lazy-loading 'fault' on Instance uuid 8353f81c-b932-4da9-89b4-82bf9883a3c9 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:16.499725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:16.507062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7c9596d1-903e-48a7-ad95-0e121890e94f tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1304 microversion: 2.1 time: 0.095516 May 13 21:53:16.507616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 98/196] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:16 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:16.603069 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:16.603792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:16.610171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.610723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.611505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:16.611941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:16.915151 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:16.922642 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-db76a9e7-2208-476f-8988-52f6f61f75d6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.323366 May 13 21:53:16.923490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 99/197] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:16 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:17.379529 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:17.380160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:17.386175 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.386620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.387399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.387828 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.510829 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:17.518556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:17.520081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:17.521217 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2cb349fd-5d4f-4144-8ee0-9bc03d494042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.145573 May 13 21:53:17.521794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 99/198] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:17 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:17.524217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:17.524829 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:17.530763 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.531214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.531973 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.532411 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.562535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.562942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.563386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lazy-loading 'fault' on Instance uuid 8353f81c-b932-4da9-89b4-82bf9883a3c9 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:17.613240 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:17.620725 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f51ca904-58a7-48e4-9c8f-e2ded6e60321 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 200 len: 1304 microversion: 2.1 time: 0.100479 May 13 21:53:17.621292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 100/199] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:17 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:17.942849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:17.943794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:17.952736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.953188 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:17.953961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:17.954400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:18.081398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:18.088714 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b92e58fc-7d81-419c-a836-a6981567493e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.152963 May 13 21:53:18.089272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 100/200] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:17 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:18.539456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:18.540068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:18.547052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:18.547499 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:18.548259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:18.548692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:18.639192 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:18.639911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: 8353f81c-b932-4da9-89b4-82bf9883a3c9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:18.647127 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:18.647574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:18.648345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:18.648948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:18.663490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] HTTP exception thrown: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Request method failure captured: May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 HTTP/1.1 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMqg2iDfyjKOoAFjZ4fBDI1iPl7s2OIXltHoLpkfuaRAcofnuEd8fhUoIxe6B3jgbXSK7F3szL7aMyvDyRabP_Y6qcvUUMG-l0EF-W4GZBPPWCX8hB7J0htJZhyoPVvPy2R1nuAZHHF-d4qfLrqZXTAuWDTzk6WOp7_D6FYiKqQ944 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 1aef84932f4f4725bbc4095f07ebf56e May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesActionsTest-1877372100 May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:53:18.665157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1aef84932f4f4725bbc4095f07ebf56e"}]}] May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesActionsTest-1877372100 May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 1aef84932f4f4725bbc4095f07ebf56e May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesActionsTest-1877372100 May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesActionsTest-1877372100-project May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 004034ab6aca41ae893214bf0e81841b May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesActionsTest-1877372100-project May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. May 13 21:53:18.666436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '8353f81c-b932-4da9-89b4-82bf9883a3c9'} May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:53:18.667186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. May 13 21:53:18.668357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:18.669378 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Returning 404 to user: Instance 8353f81c-b932-4da9-89b4-82bf9883a3c9 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:53:18.669378 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-35ceb6da-84d4-42d1-b30b-07ffdbb13823 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9" status: 404 len: 111 microversion: 2.1 time: 0.032087 May 13 21:53:18.669378 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 101/201] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:18 2022] GET /compute/v2.1/servers/8353f81c-b932-4da9-89b4-82bf9883a3c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 21:53:18.681474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:18.689680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:18.691367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:18.692659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-35a1e63a-1db3-4dec-8e0d-4ef86b695b86 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.157089 May 13 21:53:18.693251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 101/202] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:18 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:18.770536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1307407693", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "networks": [{"uuid": "8fdb1b48-8d7a-41bf-9d07-073be7f93649"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:19.105936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:19.106526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:19.113522 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:19.113972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:19.115051 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:19.115496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:19.242192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:19.249467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e64f906f-1b3c-4f35-9f02-49667ffc4378 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.147295 May 13 21:53:19.250039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 102/203] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:19 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:19.711746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:19.712378 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:19.719292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:19.719736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:19.720492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:19.720923 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:19.848902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:19.856643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:19.858134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:19.859307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7ecab85b-267e-4519-a4c7-4c6a282c87cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.151431 May 13 21:53:19.859872 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 103/204] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:19 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:20.266307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:20.266885 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:20.272668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:20.273119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:20.273873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:20.274311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:20.411654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:20.418975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a2e0dd3c-ccda-4421-ba39-0c5e01217195 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.157027 May 13 21:53:20.420052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 104/205] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:20 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:20.877026 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:20.877680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:20.883963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:20.884413 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:20.885178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:20.885619 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:21.015652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:21.023360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:21.024863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:21.026060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c692175d-31fb-4a99-9a5d-7c5331d6fb64 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.152841 May 13 21:53:21.026821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 105/206] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:20 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:21.435377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:21.436031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:21.442249 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:21.442728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:21.443499 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:21.443940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:21.575815 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:21.583054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-366e879b-5789-41c4-8f3f-f889cd3e8426 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1521 microversion: 2.1 time: 0.151486 May 13 21:53:21.583616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 106/207] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:21 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:22.050918 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:22.050918 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:22.054731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.055201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.056046 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.056508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.197466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:22.209052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:22.211005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:22.212660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-29364220-5f8d-4f35-97c0-516ba4e0d22d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.171638 May 13 21:53:22.213229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 107/208] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:22 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:22.600860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:22.601414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:22.607745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.608188 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.608953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.609495 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.749348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:22.756657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ce136eda-5d17-4fa1-a5b5-45ea1e4202fc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1501 microversion: 2.1 time: 0.160307 May 13 21:53:22.757272 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 108/209] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:22 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:22.773620 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:22.774259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:22.780133 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.780659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.781476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:22.781968 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:22.915899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:22.923771 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-76b106aa-40d7-4a40-ad22-1fa9c9478545 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1516 microversion: 2.1 time: 0.153886 May 13 21:53:22.924367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 109/210] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:22 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:23.235234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:23.236587 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:23.251163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:23.251890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:23.252876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:23.253584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:23.425770 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:23.433715 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:23.435747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:23.437072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a29abcd2-da7d-417a-b393-e846a73f6796 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.206309 May 13 21:53:23.437915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 110/211] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:23 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:24.348773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:24.349808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:24.356335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.357352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.358133 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.358575 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.382085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lazy-loading 'flavor' on Instance uuid 80f3e7ea-df2f-4358-a44c-ea4e9520b05c {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:24.491585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-976b6fc7-e0cb-4191-9a43-9e26dc40789f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/action" status: 200 len: 32 microversion: 2.1 time: 0.146780 May 13 21:53:24.492408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 111/212] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:53:24 2022] POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 21:53:24.497216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:24.497904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:24.503937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.504384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.505148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.505842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.646803 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:24.657423 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:24.659063 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:24.660411 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-486383f5-3a63-4a06-bb3f-e80212cd7b38 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.167009 May 13 21:53:24.660978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 112/213] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:24 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:24.666052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:24.666997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:24.673643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.674192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.675274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:24.675989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:24.831735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:24.844457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0bf9e87a-5376-49cc-bc43-4900f5fe0412 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.182130 May 13 21:53:24.845052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 113/214] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:24 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:25.690019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:25.690679 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:25.697023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:25.697461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:25.698226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:25.698667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:25.832472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:25.840217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:25.841727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:25.842924 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ec3493c1-d322-4eec-8db6-dd44c569741e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.157492 May 13 21:53:25.843487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 114/215] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:25 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:25.861445 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:25.862058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:25.868490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:25.868945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:25.869721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:25.870162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:25.996578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:26.003972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3e6904fb-3688-4d17-baa1-513c1397d17f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.146733 May 13 21:53:26.004572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 115/216] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:25 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:26.861089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:26.861958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:26.868941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:26.869391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:26.870165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:26.870600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:27.007651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:27.018370 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:27.020263 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:27.024511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2efc5edc-a45a-49b8-99dc-27fac902bc43 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.167434 May 13 21:53:27.025356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 116/217] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:26 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:27.031585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:27.032202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:27.040848 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:27.041301 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:27.042078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:27.042516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:27.178218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:27.185439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a5f5ec7f-6375-458b-a76c-86def39ab4ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.158781 May 13 21:53:27.186004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 117/218] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:27 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:28.046533 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:28.047205 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:28.054473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:28.055291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:28.056702 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:28.057430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:28.205200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:28.212859 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:28.214354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:28.215533 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-98702172-187f-497d-939e-5c42f50e2f93 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.173467 May 13 21:53:28.216091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 118/219] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:28 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:28.221206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:28.221977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:28.234961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:28.235507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:28.237253 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:28.237253 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:28.377947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:28.385637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0a9f6115-b1e6-40e0-9978-a0862e388827 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.168453 May 13 21:53:28.386216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 119/220] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:28 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:29.234765 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:29.235416 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:29.241840 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:29.242291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:29.243084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:29.243535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:29.377878 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:29.386335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:29.387983 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:29.389144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-78158d74-154d-4022-a047-6c0ae95f809f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.158931 May 13 21:53:29.389703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 120/221] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:29 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:29.402351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:29.403005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:29.408790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:29.409236 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:29.409997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:29.410427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:29.538451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:29.546216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f746b6a0-2a9a-4ceb-adad-a22264b125dd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.146755 May 13 21:53:29.546797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 121/222] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:29 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:30.408457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:30.409075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:30.415629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:30.416075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:30.416855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:30.417293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:30.551710 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:30.559522 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:30.561023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:30.562682 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-03eb95f3-7fdc-409c-8e89-9c9526f401a0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.158135 May 13 21:53:30.563290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 122/223] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:30 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:30.570214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:30.570214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:30.573902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:30.574352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:30.575163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:30.575596 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:30.704528 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:30.712380 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b73d83d9-ac2a-4d86-a627-fb72ae06dafc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.148088 May 13 21:53:30.713517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 123/224] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:30 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:30.754975 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] validate_networks() for [('8fdb1b48-8d7a-41bf-9d07-073be7f93649', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:53:31.306462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:53:31.306920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:53:31.307401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:53:31.307810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:53:31.308253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:53:31.317120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.317572 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.318363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.318823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.334888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Getting quotas for project 1aef84932f4f4725bbc4095f07ebf56e. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:53:31.338714 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Getting quotas for user 004034ab6aca41ae893214bf0e81841b and project 1aef84932f4f4725bbc4095f07ebf56e. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:53:31.349953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:53:31.352304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:53:31.401348 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9ba40985-2b44-4da9-991c-b2f8872a5464 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.636484 May 13 21:53:31.402287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 102/225] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 12639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:53:31.412602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c2f3af2f-6182-496b-88de-5f61adcab5d5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:31.413331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c2f3af2f-6182-496b-88de-5f61adcab5d5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:31.494093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c2f3af2f-6182-496b-88de-5f61adcab5d5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:31.500964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c2f3af2f-6182-496b-88de-5f61adcab5d5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1214 microversion: 2.1 time: 0.092353 May 13 21:53:31.501524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 124/226] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:31 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:31.581747 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:31.582365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:31.589429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.589429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.590176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.590741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.734190 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:31.734436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:31.734839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:31.744929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:31.746931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:31.747690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.748118 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1e6ce5b5-07c6-46cb-8439-81f16064381f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.171055 May 13 21:53:31.748532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.748740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 103/227] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:31 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:31.749502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:31.750103 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:31.902047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:31.909447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6c3f3336-c208-4875-9f32-22a0c888db2c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.184231 May 13 21:53:31.910018 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 125/228] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:31 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:32.517689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:32.518483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:32.524443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.524825 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.525581 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.526014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.623286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:32.631538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a12f1bee-aca1-4456-b6ae-217d0fd0001c tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1274 microversion: 2.1 time: 0.117740 May 13 21:53:32.632369 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 104/229] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:32 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:32.765419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:32.766030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:32.772349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.772878 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.773660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.774091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.927071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:32.927930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:32.933716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.934182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.934966 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:32.935479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:32.969218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:32.978526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:32.982018 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:32.984023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9dc55441-a987-49b5-b37d-e154c12579f3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.222525 May 13 21:53:32.984681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 126/230] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:32 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:33.141734 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:33.149029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8d295353-b76c-4d60-aebe-7a7d5e808402 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.225902 May 13 21:53:33.149784 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 105/231] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:32 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:33.649125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:33.649738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:33.655977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:33.657028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:33.657831 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:33.658316 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:33.789429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:33.797201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-69914680-cef6-4615-905e-5b29cbc7b1a7 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.151937 May 13 21:53:33.797772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 127/232] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:33 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:34.003583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:34.004341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:34.009877 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.010315 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.011086 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.011515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.135254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:34.143125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:34.144663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:34.145793 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6ca67bef-1975-4cd1-a24b-837589e874cd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.146136 May 13 21:53:34.146341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 106/233] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:33 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:34.166100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:34.166714 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:34.173123 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.173566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.174319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.174769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.306045 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:34.313286 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-603ffa71-a925-4415-b156-36d1661ac27a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.150936 May 13 21:53:34.313845 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 128/234] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:34 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:34.813718 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:34.814323 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:34.820159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.820602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.821350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:34.821778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:34.946816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:34.954673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-08c5183c-8dd8-4a06-b566-673f0a99c834 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.144668 May 13 21:53:34.955257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 107/235] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:34 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:35.163762 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:35.164372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:35.170655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.171138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:35.171904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.172343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:35.301565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:35.309125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:35.310614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:35.312449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8961bdfc-d87e-47b8-b821-a8fbdec48593 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.152662 May 13 21:53:35.313001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 129/236] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:35 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:35.329110 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:35.329749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:35.335716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.336168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:35.336931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.337364 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:35.463028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:35.470261 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5cfbe068-d2f3-4571-a71e-1d97d37b818c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.144932 May 13 21:53:35.470838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 108/237] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:35 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:35.971657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:35.972263 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:35.978090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.978530 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:35.979309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:35.979742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:36.106907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:36.114122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-824d968f-1d42-4e93-9cb2-d89c8c288807 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.146697 May 13 21:53:36.114982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 130/238] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:35 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:36.331231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:36.331832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:36.337751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:36.338213 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:36.338984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:36.339435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:36.487164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:36.487776 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:36.494662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:36.495334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:36.496260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:36.496703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:36.531557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:36.539355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:36.540850 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:36.542018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f730236f-a3ae-4a6d-99fb-be4c4b75d484 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.215287 May 13 21:53:36.551515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 109/239] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:36 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:36.735925 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:36.743822 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d078c6dd-7fb2-4091-8250-a3d1a4438da1 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.260525 May 13 21:53:36.747170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 131/240] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:36 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:37.131722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:37.132457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:37.133393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-cf5d9587-12d6-45a1-966a-434f1944ff1f req-08243248-3888-4c10-b5ef-d49e4b47d64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48832e6-4c40-42dd-be77-7604f10c2c87", "tag": "5a590723-5c25-43fd-9d17-b505c89668e1"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:37.142162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.142953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.143646 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-cf5d9587-12d6-45a1-966a-434f1944ff1f req-08243248-3888-4c10-b5ef-d49e4b47d64f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.144234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-cf5d9587-12d6-45a1-966a-434f1944ff1f req-08243248-3888-4c10-b5ef-d49e4b47d64f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.144612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.145266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.160414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-cf5d9587-12d6-45a1-966a-434f1944ff1f req-08243248-3888-4c10-b5ef-d49e4b47d64f service nova] Creating event network-changed:5a590723-5c25-43fd-9d17-b505c89668e1 for instance c48832e6-4c40-42dd-be77-7604f10c2c87 on hv-cinder-84051 May 13 21:53:37.166019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-cf5d9587-12d6-45a1-966a-434f1944ff1f req-08243248-3888-4c10-b5ef-d49e4b47d64f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036086 May 13 21:53:37.167092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 132/241] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:53:37.329007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:37.336258 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5470fcb4-7cf7-4152-afeb-ecfe4014a235 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.208729 May 13 21:53:37.336836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 110/242] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:37 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:37.561587 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:37.562292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:37.569736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.570515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.571537 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.572202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.748194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:37.756318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:37.758998 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:37.759875 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d2fa8842-be6e-41d3-8ac9-b94cd932f9b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.203091 May 13 21:53:37.760538 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 133/243] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:37 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:37.763030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:37.763641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:37.772763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.773223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.774005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:37.774448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:37.953786 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:37.963904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-211ff090-0eef-4ec8-8c5b-d165e32e4dd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.204714 May 13 21:53:37.964795 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 111/244] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:37 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:38.354248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:38.355076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:38.361985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:38.362428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:38.363244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:38.364325 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:38.509645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:38.517331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f3dbd690-2853-4429-b640-6231fcdf1f23 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.167745 May 13 21:53:38.517908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 134/245] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:38 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:38.778928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:38.780611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:38.786443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:38.786938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:38.787878 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:38.788311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:38.969705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:38.979222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:38.980996 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:38.981725 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:38.985250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:38.986929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1f05c94a-30b9-410a-b932-9d832ac5b6be tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1742 microversion: 2.20 time: 0.212081 May 13 21:53:38.987945 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 112/246] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:38 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:38.998084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:38.998655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:38.999615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:39.000427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:39.216341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:39.227892 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-96f34dfb-4062-4415-80bd-19f74fc78f7d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.251271 May 13 21:53:39.228350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 135/247] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:38 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:39.313506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-536392325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476909752", "security_groups": [{"name": "tempest-secgroup-smoke-1802433148"}], "block_device_mapping_v2": [{"uuid": "2c1ed20a-2301-4664-a5ae-128edadcd890", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db469d62-9f19-4947-a3c5-257e3bf41ebd"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:39.439167 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] validate_networks() for [('db469d62-9f19-4947-a3c5-257e3bf41ebd', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:53:39.533925 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:39.534473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:39.541027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:39.541479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:39.542382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:39.542854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:39.757529 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:39.766320 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9ae43547-2bf0-423b-b58b-98fe14675b49 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.236654 May 13 21:53:39.767078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 136/248] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:39 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:39.930449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:53:39.930982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:53:39.931399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:53:39.932224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:53:39.932818 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:53:39.943304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:39.943750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:39.944550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:39.944986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:39.962000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:53:39.966374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for user c3a0de9ca12746be893b97d3cd11b826 and project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:53:40.010288 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:40.010927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:40.018346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.019129 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:40.020134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.021450 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:40.055170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:53:40.057135 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c1ed20a-2301-4664-a5ae-128edadcd890',volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:53:40.238623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ae85abc0-6061-411c-81ea-9411bb8a3562 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929054 May 13 21:53:40.242984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 113/249] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:53:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:53:40.254170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:40.255394 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:40.287484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.288573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:40.289639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.291169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:40.506484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:40.517645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:40.521637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:40.524849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-53781815-5096-4ffe-8906-c977c48fe24c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1742 microversion: 2.20 time: 0.518473 May 13 21:53:40.540130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 137/250] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:40 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1742 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:40.544991 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-20a26c3b-b7dd-4065-866f-91fc82a1a973 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:40.553659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-20a26c3b-b7dd-4065-866f-91fc82a1a973 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:40.646680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-20a26c3b-b7dd-4065-866f-91fc82a1a973 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:40.662896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-20a26c3b-b7dd-4065-866f-91fc82a1a973 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1093 microversion: 2.1 time: 0.121504 May 13 21:53:40.663899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 138/251] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:40 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1093 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:40.688792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:40.698457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6d2f3e13-1d49-46e6-96c1-e7bcf8b5ef4e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.449852 May 13 21:53:40.700496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 114/252] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:40 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:40.785049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:40.786178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:40.794745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.795758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:40.797435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:40.798527 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.059238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:41.071563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d721d4fa-9f6d-421c-8370-19a625cff407 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.292196 May 13 21:53:41.072388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 139/253] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:40 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:41.544721 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:41.545485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:41.555158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.556131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.556932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.557371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.680384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:41.681003 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:41.688426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.688884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.689671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.690114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.736756 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:41.748489 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:41.752231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:41.755886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0f522b35-4e21-46f0-8eaf-36ba5e6c1b54 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1742 microversion: 2.20 time: 0.214980 May 13 21:53:41.756479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 115/254] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:41 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1742 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:41.769966 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:41.770610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:41.777109 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.777766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.778734 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:41.779334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:41.802656 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:41.810114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d8b77c0d-d8ac-41ec-88a5-0ba4b14cc709 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1191 microversion: 2.1 time: 0.132273 May 13 21:53:41.810917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 140/255] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:41 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:41.994278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:42.003981 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a694dc6a-a3cf-4c37-a15d-62b279335c0f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.244057 May 13 21:53:42.005326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 116/256] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:41 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:42.093689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:42.096089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:42.104840 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.105587 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.106621 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.107263 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.287028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:42.295831 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a52bf9b6-3869-4a72-b83b-1cec3f436026 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.209333 May 13 21:53:42.296422 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 141/257] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:42 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:42.774012 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:42.775019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:42.782526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.783003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.783769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.784357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.827344 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:42.828087 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:42.836594 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.837361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.839158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:42.840001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:42.940915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:42.951211 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-22bcdecb-16b3-4812-9b18-8988130c908a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1209 microversion: 2.1 time: 0.126969 May 13 21:53:42.954080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 142/258] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:42 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:43.022760 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:43.023394 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:43.032929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:43.033420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:43.035349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:43.035799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:43.252504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:43.268552 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:43.278649 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:43.290518 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-026f955a-d45e-41ba-b292-f0d711a6f7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.520263 May 13 21:53:43.291839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 117/259] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:42 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:43.298486 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-87671f32-2b3d-4aaa-aa08-88f0f89837d0 req-c53e653e-8ee4-48ab-a4d5-8ff05d773155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "name": "network-vif-plugged", "status": "completed", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:43.310432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-87671f32-2b3d-4aaa-aa08-88f0f89837d0 req-c53e653e-8ee4-48ab-a4d5-8ff05d773155 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:43.311166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-87671f32-2b3d-4aaa-aa08-88f0f89837d0 req-c53e653e-8ee4-48ab-a4d5-8ff05d773155 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:43.330632 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-87671f32-2b3d-4aaa-aa08-88f0f89837d0 req-c53e653e-8ee4-48ab-a4d5-8ff05d773155 service nova] Creating event network-vif-plugged:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:53:43.337879 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-87671f32-2b3d-4aaa-aa08-88f0f89837d0 req-c53e653e-8ee4-48ab-a4d5-8ff05d773155 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044329 May 13 21:53:43.339715 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 118/260] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:43.351243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:43.352094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:43.362568 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:43.363104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:43.363889 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:43.364683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:43.392441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:43.406545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9e5bed7c-a76e-4863-b04c-36be5a43b502 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.387960 May 13 21:53:43.409560 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 143/261] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:43 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:43.770418 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:43.783535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d2449e23-ca74-4b48-8303-cbfbebbbbd81 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.441221 May 13 21:53:43.786042 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 119/262] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:43 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:43.982457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:43.983264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:44.002755 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.003343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:44.004949 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.005589 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:44.133526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:44.151839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-29efdcd9-e71a-4d16-8d28-ad6b06f92cf7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1209 microversion: 2.1 time: 0.182059 May 13 21:53:44.161817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 144/263] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:43 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:44.309545 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:44.310208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:44.317695 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.323892 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:44.325875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.333814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:44.425863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:44.426477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:44.439847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.439847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:44.449719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:44.450218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.023366 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.045991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.053807 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.057640 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d12c0d26-3687-41e2-b593-afb15f97a17c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.750964 May 13 21:53:45.061749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 120/264] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:44 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:45.079636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:45.083350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:45.085093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.094278 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-605dedb6-df3b-4ee9-98d6-c719d7207168 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.672219 May 13 21:53:45.098476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 145/265] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:44 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:45.115130 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:45.120937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.123841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:45.124446 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.177637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:45.178245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:45.197598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:45.204051 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.205131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:45.208055 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.572009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.583604 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9534005b-436d-4f58-99f3-c731f8ffbc29 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.520144 May 13 21:53:45.585685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 121/266] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:45 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:45.593922 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-4096dd47-e4ab-4823-8e17-44cc2acdc244 req-85977ee3-d171-400c-a3d3-38f81562613f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48832e6-4c40-42dd-be77-7604f10c2c87", "name": "network-vif-plugged", "status": "completed", "tag": "5a590723-5c25-43fd-9d17-b505c89668e1"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:45.620722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-4096dd47-e4ab-4823-8e17-44cc2acdc244 req-85977ee3-d171-400c-a3d3-38f81562613f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:45.625157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-4096dd47-e4ab-4823-8e17-44cc2acdc244 req-85977ee3-d171-400c-a3d3-38f81562613f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:45.649577 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:45.659000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-4096dd47-e4ab-4823-8e17-44cc2acdc244 req-85977ee3-d171-400c-a3d3-38f81562613f service nova] Creating event network-vif-plugged:5a590723-5c25-43fd-9d17-b505c89668e1 for instance c48832e6-4c40-42dd-be77-7604f10c2c87 on hv-cinder-84051 May 13 21:53:45.671765 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-4096dd47-e4ab-4823-8e17-44cc2acdc244 req-85977ee3-d171-400c-a3d3-38f81562613f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083413 May 13 21:53:45.673490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-570e59a6-25c5-490c-a81f-601977524578 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.499923 May 13 21:53:45.674085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 146/267] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:45 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:45.679808 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 122/268] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:46.080977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:46.081575 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:46.091028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.094386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.095976 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.100391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.116636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:46.117320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:46.126565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.129977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.131031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.131637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.466808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:46.478330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:46.485650 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:46.490492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-309d7cdc-02e2-45f0-b242-466b10978a0a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.413319 May 13 21:53:46.500636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:46.504598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 147/269] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:46 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:46.510372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4d812ecf-1345-4dd6-991e-0cea4c5c05d9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.398821 May 13 21:53:46.510995 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 123/270] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:46 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:46.601819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:46.602697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:46.622238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.623876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.626377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.628330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.690836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:46.692416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:46.721123 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.721806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:46.724994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:46.727578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.296333 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.313719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-82e5d393-fd12-4144-823d-41ce7c6bf8b5 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.713559 May 13 21:53:47.313719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 148/271] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:46 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:47.317289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-04805c05-89a9-49f9-8176-331b18c29771 req-1c90cfb6-32e6-4ebc-b757-4b0b422a95a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c1fa86-0199-416e-906e-ecbb3d1e510f", "tag": "c4df6d51-ad13-478c-b857-3f2949f60980"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:47.336277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-04805c05-89a9-49f9-8176-331b18c29771 req-1c90cfb6-32e6-4ebc-b757-4b0b422a95a6 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:47.336970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-04805c05-89a9-49f9-8176-331b18c29771 req-1c90cfb6-32e6-4ebc-b757-4b0b422a95a6 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.363579 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-04805c05-89a9-49f9-8176-331b18c29771 req-1c90cfb6-32e6-4ebc-b757-4b0b422a95a6 service nova] Creating event network-changed:c4df6d51-ad13-478c-b857-3f2949f60980 for instance 95c1fa86-0199-416e-906e-ecbb3d1e510f on hv-cinder-84051 May 13 21:53:47.369634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-04805c05-89a9-49f9-8176-331b18c29771 req-1c90cfb6-32e6-4ebc-b757-4b0b422a95a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056074 May 13 21:53:47.373420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 149/272] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:47.417550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.428189 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e50fed42-f06c-45f2-b4e0-cf2d0aca6a5a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.742601 May 13 21:53:47.439018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 124/273] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:46 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:47.519224 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:47.529419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:47.530517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:47.537957 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:47.548376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:47.553214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.555911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:47.557929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.572375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:47.577329 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.578674 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:47.585987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:47.854302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.869235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bc22127c-9877-440f-ae7a-86d269c775cd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.344726 May 13 21:53:47.869838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 125/274] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:47 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:47.892083 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.900488 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.902195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:47.903544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-596e21af-3fc1-417f-830f-054a81cdde00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.394674 May 13 21:53:47.905551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 150/275] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:47 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:48.328773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:48.329653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:48.336789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.340821 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.342207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.343417 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.445783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:48.446414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:48.454765 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.467122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.468342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.469131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.687306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:48.698901 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5c9a0612-3b27-49cd-adb9-b1d617b230db tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1314 microversion: 2.1 time: 0.374251 May 13 21:53:48.709692 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 126/276] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:48 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:48.811058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:48.826036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cd68bd66-3fa6-42c9-9f06-a7ae21b34aa0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.384011 May 13 21:53:48.827987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 151/277] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:48 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:48.893089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:48.901721 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:48.911232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.912304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.913840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.914890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.930947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:48.932411 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:48.951913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.952665 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:48.953811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:48.954749 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:49.302939 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:49.321147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:49.322651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:49.324014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2d091325-de36-444e-bb9d-2530cfceb06f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.400202 May 13 21:53:49.327314 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 152/278] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:48 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:49.400695 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:49.408871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ed658132-466d-44ed-a19c-b6887c37affd tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.522492 May 13 21:53:49.419409 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 127/279] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:48 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:49.715555 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:49.716819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:49.732110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:49.732492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:49.733376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:49.733782 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:49.856487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:49.857512 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:49.878881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:49.883516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:49.884428 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:49.884878 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:50.121170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.140086 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ea5fb5a3-1e9d-4626-acd7-b36be0fd288b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.279720 May 13 21:53:50.169450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 128/280] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:49 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:50.196573 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.212640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7f7bdf5c-d239-4f6d-b246-b5e5c7ba5528 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1499 microversion: 2.1 time: 0.500778 May 13 21:53:50.225989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 153/281] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:49 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1499 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:50.343802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:50.344691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:50.350884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:50.351684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:50.352736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:50.353335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:50.426602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:50.427481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:50.434999 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:50.439353 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:50.440426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:50.443545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:50.644946 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.651708 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.660581 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.663041 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:50.664725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-159a3ee1-423e-48e6-942c-e393bd82d8ce tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.324720 May 13 21:53:50.664967 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cc0c30fd-642f-45f2-a4cf-c415e3509010 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.241019 May 13 21:53:50.665804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 129/282] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:50 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:50.677663 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 154/283] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:50 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:51.156401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:51.158228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:51.165214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.165673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.166685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.167152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.349977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:51.355749 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:51.378898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.388236 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.389557 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.390274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.462330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:51.465132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:53:51.471210 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f9b0a1e0-52e9-4d55-876b-d1ff71160240 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.318720 May 13 21:53:51.481506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 130/284] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:51 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:51.601511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4e4ed9b1-a1d9-45c5-bfe5-281ac4d800a8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 204 len: 0 microversion: 2.1 time: 0.255175 May 13 21:53:51.602485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 155/285] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:53:51 2022] DELETE /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:53:51.611991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:51.612701 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:51.623804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.625132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.626231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.626869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.686838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:51.687784 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:51.705220 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.706135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.707151 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.707987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.883875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:51.893877 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-09f86aa2-8109-4d7e-99c7-133b22b920f2 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1505 microversion: 2.1 time: 0.286700 May 13 21:53:51.899706 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 131/286] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:51 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:51.905242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:51.912108 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:51.926421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.929027 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:51.939820 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:51.940587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.022466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.033523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.035325 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.036774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bef648db-07d2-4e47-a9cc-d87d94689431 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.355022 May 13 21:53:52.046750 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 156/287] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:51 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:52.182287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.193847 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-603b1b24-cdde-4e10-84bd-a16119af3205 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1502 microversion: 2.1 time: 0.292789 May 13 21:53:52.206578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 132/288] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:51 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:52.211182 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46dcfb4f-c0a4-4386-ab03-a419fb5b12bd"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:52.212318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:52.219001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.219748 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.220710 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.221565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.253330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] HTTP exception thrown: Cannot 'attach_volume' instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c while it is in vm_state rescued May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Request method failure captured: May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/os-volume_attachments HTTP/1.1 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 74 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftL6obtLfoMakldR6LzjoEXadqit41RP1TrdbbcjtNpiAXkZsqTgRzLC2AEGm9VaL6QSK4iwx3ZJBYbrG3e3Vi-_1uGU_N7L8E0jn1VdsUyUqgMbdl_J22hiDw6XPuIENkCKnExuyTiyyxgYwlGR92lsbysvJuipuFRsdhtxEFupi1k May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:53:52.255441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_428d047f511945e5bdf35eb8ed236507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/428d047f511945e5bdf35eb8ed236507"}]}] May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 6b11a3de8b71482594a04ab7e53a94bd May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {"volumeAttachment": {"volumeId": "46dcfb4f-c0a4-4386-ab03-a419fb5b12bd"}} May 13 21:53:52.256944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Cannot 'attach_volume' instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c while it is in vm_state rescued May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'server_id': '80f3e7ea-df2f-4358-a44c-ea4e9520b05c', 'body': {'volumeAttachment': {'volumeId': '46dcfb4f-c0a4-4386-ab03-a419fb5b12bd'}}} May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:53:52.257832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c while it is in vm_state rescued May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:52.259218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:52.260509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:53:52.260509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:53:52.260509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c while it is in vm_state rescued May 13 21:53:52.260509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:53:52.261460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Returning 409 to user: Cannot 'attach_volume' instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c while it is in vm_state rescued {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:53:52.262676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-39912657-f4cd-448d-aba0-8c18d090cbb0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055920 May 13 21:53:52.263759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 157/289] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:53:52 2022] POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 21:53:52.276993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:52.277532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:52.284355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.284863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.286355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.287069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.413051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-67fc1525-116e-4366-9f1b-b81b29bd6cb9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/action" status: 202 len: 0 microversion: 2.1 time: 0.140767 May 13 21:53:52.418950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 133/290] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:53:52 2022] POST /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:53:52.423696 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:52.425646 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:52.432401 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.433095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.434348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.435019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.493907 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:52.495054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:52.508051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.509376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.512250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.513089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.714327 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.723430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1afb1dbf-7372-4384-adad-c0061ec7ca17 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.303661 May 13 21:53:52.726006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 158/291] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:52 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:52.817148 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:52.826003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-20c988f5-4a47-4e33-b758-6616f8412a75 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.340878 May 13 21:53:52.826869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 134/292] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:52 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:52.916746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:52.917871 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:52.924989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.925717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:52.926681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:52.927302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.055137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:53.056080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:53.062510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.064015 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.066734 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.067322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.134002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:53.146884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8f4b1a3b-179d-45b8-8260-5a37ad897ee8 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1505 microversion: 2.1 time: 0.232741 May 13 21:53:53.150042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 159/293] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:52 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:53.417567 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:53.428451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:53.430559 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:53.432116 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bc1697d6-00cc-4ace-a1a7-bd2bf1573f01 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.380898 May 13 21:53:53.433392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 135/294] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:53 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:53.745290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:53.746548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:53.758767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.759476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.760640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.761352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.843030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:53.843687 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:53.860448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.861153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.862150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:53.862766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:53.994486 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.002579 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6d857488-661e-4e09-9988-ab0ce9f92889 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.264060 May 13 21:53:54.006164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 160/295] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:53 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:54.075152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.090290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9cb46e7f-3ec0-43fc-805f-4cd1a05052bc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.250980 May 13 21:53:54.108242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 136/296] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:53 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:54.165768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:54.166387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:54.172982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:54.173438 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:54.174205 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:54.174644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:54.322693 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.330565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4dadb086-fdf4-41d2-9f85-92f9e2f63e19 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1505 microversion: 2.1 time: 0.168765 May 13 21:53:54.340041 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 161/297] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:54 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:54.454688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:54.456302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:54.466749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:54.470001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:54.470893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:54.471381 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:54.626387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.635792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.637921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:54.639139 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1d46ebae-919b-45b0-b122-31ee16432598 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.191376 May 13 21:53:54.649888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 137/298] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:54 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:55.019897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:55.021307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:55.027846 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.028420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.029277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.030350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.107578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:55.108306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:55.115956 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.122651 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.124330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.124950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.190318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.199416 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-355c2c7e-1b40-4153-bc69-fa783d745fcb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.182961 May 13 21:53:55.200244 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 162/299] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:55 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:55.326993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.335159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ec978272-ef82-4250-81d3-b74494e8f3a5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.231330 May 13 21:53:55.336103 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 138/300] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:55 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:55.351515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:55.352292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:55.359147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.359720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.360584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.361113 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.523365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.531655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b7dc0555-51f1-4229-807e-9637903508df tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1505 microversion: 2.1 time: 0.187554 May 13 21:53:55.532221 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 163/301] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:55 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:55.657563 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:55.658753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:55.665029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.665690 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.666639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:55.667086 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:55.825936 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.834058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.835982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:55.837361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fd3229c9-3468-4f1e-80c5-021e03681951 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.183791 May 13 21:53:55.842804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 139/302] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:55 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:56.219669 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:56.220614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:56.228240 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.228817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.229769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.230207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.352328 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:56.353130 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:56.361242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.361972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.363183 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.363828 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.458252 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:56.471921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-dd85ae5f-c015-4ae5-ab5e-7bf25b5373bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.258579 May 13 21:53:56.486093 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 164/303] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:56 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:56.552221 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:56.553284 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:56.560784 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.561532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.562524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.563197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.571937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:56.582185 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-44f168ec-fcfb-46dc-ba2e-2811dfb0f9f3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.233606 May 13 21:53:56.586806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 140/304] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:56 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:56.731696 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:56.739384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e1027145-f400-4f97-b89e-206dd5fcf258 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1505 microversion: 2.1 time: 0.192150 May 13 21:53:56.750576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 165/305] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:56 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:56.855314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:56.855925 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:56.862375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.874298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.874298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.874298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.937258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-13033097-434a-4a87-80ce-b96d4d5c7661 req-e1c4277c-9989-439c-8336-5f8e6bf9e091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48832e6-4c40-42dd-be77-7604f10c2c87", "name": "network-vif-unplugged", "status": "completed", "tag": "5a590723-5c25-43fd-9d17-b505c89668e1"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:56.959398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-13033097-434a-4a87-80ce-b96d4d5c7661 req-e1c4277c-9989-439c-8336-5f8e6bf9e091 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:56.959936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-13033097-434a-4a87-80ce-b96d4d5c7661 req-e1c4277c-9989-439c-8336-5f8e6bf9e091 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:56.998913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-13033097-434a-4a87-80ce-b96d4d5c7661 req-e1c4277c-9989-439c-8336-5f8e6bf9e091 service nova] Creating event network-vif-unplugged:5a590723-5c25-43fd-9d17-b505c89668e1 for instance c48832e6-4c40-42dd-be77-7604f10c2c87 on hv-cinder-84051 May 13 21:53:57.020740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-13033097-434a-4a87-80ce-b96d4d5c7661 req-e1c4277c-9989-439c-8336-5f8e6bf9e091 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081301 May 13 21:53:57.026053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 166/306] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:53:57.115925 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:57.130390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:57.132520 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:57.133901 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f70f5181-7cf8-4740-9033-e4b17df12a00 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.282337 May 13 21:53:57.135390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 141/307] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:56 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:53:57.489668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-5ab11785-8061-4d89-9172-34473d89f955 req-ee1edccc-a99f-450a-a6b2-baa6f1ea8f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48832e6-4c40-42dd-be77-7604f10c2c87", "name": "network-vif-deleted", "tag": "5a590723-5c25-43fd-9d17-b505c89668e1"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:53:57.493013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:57.493811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:57.505895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.507197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:57.508350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.509632 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:57.520732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5ab11785-8061-4d89-9172-34473d89f955 req-ee1edccc-a99f-450a-a6b2-baa6f1ea8f2d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.522388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5ab11785-8061-4d89-9172-34473d89f955 req-ee1edccc-a99f-450a-a6b2-baa6f1ea8f2d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:57.540814 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-5ab11785-8061-4d89-9172-34473d89f955 req-ee1edccc-a99f-450a-a6b2-baa6f1ea8f2d service nova] Creating event network-vif-deleted:5a590723-5c25-43fd-9d17-b505c89668e1 for instance c48832e6-4c40-42dd-be77-7604f10c2c87 on hv-cinder-84051 May 13 21:53:57.568605 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-5ab11785-8061-4d89-9172-34473d89f955 req-ee1edccc-a99f-450a-a6b2-baa6f1ea8f2d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080646 May 13 21:53:57.572421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 167/308] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:53:57.598776 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:57.599753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:57.611581 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.613125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:57.615021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.617208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:57.934298 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:57.951005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-71a9661b-3b3a-4591-bb51-1a0e52f0657a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.352164 May 13 21:53:57.952356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 168/309] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:57 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:53:57.962606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:57.964292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:57.980815 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:57.989846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:58.000510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-11525872-3ac8-44fd-9787-a152f446df62 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.511734 May 13 21:53:58.001624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 142/310] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:57 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:58.006977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.008010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.009451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.070506 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.080460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.081056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lazy-loading 'fault' on Instance uuid c48832e6-4c40-42dd-be77-7604f10c2c87 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:53:58.154210 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:58.155494 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:58.164419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.168607 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004034ab6aca41ae893214bf0e81841b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aef84932f4f4725bbc4095f07ebf56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:58.183996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.184988 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.185443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.189599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e19fd7da-1bf2-46ca-a21d-c154d97b41f0 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 200 len: 1304 microversion: 2.1 time: 0.233361 May 13 21:53:58.198846 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 169/311] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:57 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:58.412916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:58.424011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:58.427930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:58.429439 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9d834c77-79a4-475e-8b5f-0d9ddd31ff36 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.280194 May 13 21:53:58.434786 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 143/312] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:58 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:53:58.969062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:58.969591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:58.980392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.980848 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:58.981773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:58.982323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.019201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:59.020225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:59.031897 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.032612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.034092 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.047607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.339791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:59.343834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:59.352864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-79f5eb05-9a0b-4198-a449-50e14160435a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1510 microversion: 2.1 time: 0.338226 May 13 21:53:59.352864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 144/313] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:59 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:59.354538 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-44d33103-8984-416b-8fd9-19a0adec41ca tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.389635 May 13 21:53:59.355452 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 170/314] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:58 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:53:59.358688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:59.359316 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] [instance: c48832e6-4c40-42dd-be77-7604f10c2c87] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:59.365479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.365923 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.366685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.367300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.385071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] HTTP exception thrown: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Request method failure captured: May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 HTTP/1.1 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMqg2iDfyjKOoAFjZ4fBDI1iPl7s2OIXltHoLpkfuaRAcofnuEd8fhUoIxe6B3jgbXSK7F3szL7aMyvDyRabP_Y6qcvUUMG-l0EF-W4GZBPPWCX8hB7J0htJZhyoPVvPy2R1nuAZHHF-d4qfLrqZXTAuWDTzk6WOp7_D6FYiKqQ944 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 1aef84932f4f4725bbc4095f07ebf56e May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-VolumesActionsTest-1877372100 May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:53:59.387281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_1aef84932f4f4725bbc4095f07ebf56e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/1aef84932f4f4725bbc4095f07ebf56e"}]}] May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-VolumesActionsTest-1877372100 May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 1aef84932f4f4725bbc4095f07ebf56e May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-VolumesActionsTest-1877372100 May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-VolumesActionsTest-1877372100-project May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 004034ab6aca41ae893214bf0e81841b May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-VolumesActionsTest-1877372100-project May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. May 13 21:53:59.389395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c48832e6-4c40-42dd-be77-7604f10c2c87'} May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:53:59.390216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. May 13 21:53:59.391673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:53:59.392860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] Returning 404 to user: Instance c48832e6-4c40-42dd-be77-7604f10c2c87 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:53:59.392860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e3f6c978-e149-4402-b2ba-212156521124 tempest-VolumesActionsTest-1877372100 tempest-VolumesActionsTest-1877372100-project] 10.222.0.35 "GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87" status: 404 len: 111 microversion: 2.1 time: 0.033887 May 13 21:53:59.394161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 145/315] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:53:59 2022] GET /compute/v2.1/servers/c48832e6-4c40-42dd-be77-7604f10c2c87 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:53:59.451012 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:53:59.452264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:53:59.460534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.461369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.462873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:53:59.463625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:53:59.644146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:59.657714 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:59.660743 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:53:59.662203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-525d7c34-d10d-4aa0-81ea-49c21931c0fe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1737 microversion: 2.20 time: 0.216188 May 13 21:53:59.667648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 171/316] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:53:59 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:00.383790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:00.384386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:00.385569 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:00.386309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:00.396852 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.401998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.403260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.403722 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.405058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.406175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.408539 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.410176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.623587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:00.632577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5f864bcf-1e9d-4da8-81e5-9a37387e611a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1516 microversion: 2.1 time: 0.266791 May 13 21:54:00.633202 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 146/317] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:00 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:00.681276 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:00.681884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:00.687824 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:00.689742 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.694055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.695112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:00.696624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:00.698346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-15335fe6-61e7-412b-9a74-fe65cf56374f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.330778 May 13 21:54:00.698966 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 172/318] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:00 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:00.958304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:00.969929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:00.972295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:00.973915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f686e246-c237-4743-92a9-ba496901b9e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.296829 May 13 21:54:00.975098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 147/319] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:00 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:01.115947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-f34ba103-b0a4-4137-8f12-d613aeb0ea23 req-9240d11c-4ef5-46d0-be9c-36a4a104ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c1fa86-0199-416e-906e-ecbb3d1e510f", "name": "network-vif-plugged", "status": "completed", "tag": "c4df6d51-ad13-478c-b857-3f2949f60980"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:01.126779 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f34ba103-b0a4-4137-8f12-d613aeb0ea23 req-9240d11c-4ef5-46d0-be9c-36a4a104ff20 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:01.127433 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f34ba103-b0a4-4137-8f12-d613aeb0ea23 req-9240d11c-4ef5-46d0-be9c-36a4a104ff20 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:01.140160 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-f34ba103-b0a4-4137-8f12-d613aeb0ea23 req-9240d11c-4ef5-46d0-be9c-36a4a104ff20 service nova] Creating event network-vif-plugged:c4df6d51-ad13-478c-b857-3f2949f60980 for instance 95c1fa86-0199-416e-906e-ecbb3d1e510f on hv-cinder-84051 May 13 21:54:01.147186 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-f34ba103-b0a4-4137-8f12-d613aeb0ea23 req-9240d11c-4ef5-46d0-be9c-36a4a104ff20 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035361 May 13 21:54:01.147723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 173/320] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:54:01.721366 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:01.722750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:01.729160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:01.729937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:01.730543 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:01.731085 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:01.912205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:01.920528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b989221b-b340-4bda-ade9-34cc27ef34ae tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.208220 May 13 21:54:01.921710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 148/321] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:01 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:01.994946 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:01.995780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:02.003312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:02.004461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:02.005758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:02.006552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:02.199860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:02.209330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:02.210928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:02.212228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2f9377b1-3a16-49e2-a93a-96334d36cbde tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.223207 May 13 21:54:02.213229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 174/322] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:01 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:02.938011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:02.938647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:02.946250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:02.947071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:02.948463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:02.949036 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:03.088768 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:03.096121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2ee8d920-4654-4e65-a6d8-3ae4195eb735 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.162817 May 13 21:54:03.096683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 149/323] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:02 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:03.197082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-6f970488-3b6d-4860-a2f4-145c0f74b4ad req-c0e5995a-bf71-45e7-a1a1-5219d385d213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "name": "network-vif-unplugged", "status": "completed", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:03.206172 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-6f970488-3b6d-4860-a2f4-145c0f74b4ad req-c0e5995a-bf71-45e7-a1a1-5219d385d213 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:03.206865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-6f970488-3b6d-4860-a2f4-145c0f74b4ad req-c0e5995a-bf71-45e7-a1a1-5219d385d213 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:03.217620 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-6f970488-3b6d-4860-a2f4-145c0f74b4ad req-c0e5995a-bf71-45e7-a1a1-5219d385d213 service nova] Creating event network-vif-unplugged:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:54:03.222780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-6f970488-3b6d-4860-a2f4-145c0f74b4ad req-c0e5995a-bf71-45e7-a1a1-5219d385d213 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029957 May 13 21:54:03.223376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 175/324] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:03.231557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:03.232239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:03.239522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:03.239976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:03.240755 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:03.241196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:03.381115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:03.389458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:03.391003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:03.392150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-909de4a4-fc31-4143-883c-f592f1c5242c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.164546 May 13 21:54:03.392707 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 150/325] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:03 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:04.113076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:04.113690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:04.120106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:04.120556 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:04.121332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:04.121768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:04.253750 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:04.261704 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d4b8da5d-8772-4b05-b71e-a5606bd0c9e8 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.152737 May 13 21:54:04.262297 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 176/326] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:04 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:04.409432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:04.409991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:04.415930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:04.416378 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:04.417136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:04.417569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:04.546799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:04.554478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:04.556013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:04.557149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9783acb2-972b-4f71-b914-939cfc6bb0e1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.151632 May 13 21:54:04.557704 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 151/327] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:04 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:05.282877 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:05.283496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:05.289729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:05.290177 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:05.290970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:05.291408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:05.421277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:05.430542 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b4518d24-d4df-4c0d-9798-26c1bd88c7b4 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.152154 May 13 21:54:05.431140 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 177/328] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:05 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:05.576948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:05.577551 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:05.583382 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:05.583833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:05.584598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:05.585038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:05.717547 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:05.725149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:05.726642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:05.727807 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-befc7a45-339d-4881-9fe7-1871ef79eef9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.155907 May 13 21:54:05.728358 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 152/329] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:05 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:06.447835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:06.448437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:06.454952 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:06.455400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:06.456156 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:06.456585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:06.585128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:06.592289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4f4cf4b0-e8e2-43c3-a484-18742e821ddc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.149652 May 13 21:54:06.592820 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 178/330] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:06 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:06.745365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:06.745969 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:06.752441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:06.752889 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:06.753656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:06.754092 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:06.878218 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:06.885785 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:06.887425 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:06.888562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c392a264-6225-462a-afd5-03b8fd475dd0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1719 microversion: 2.20 time: 0.147041 May 13 21:54:06.889120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 153/331] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:06 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:07.608396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:07.609008 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:07.615531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:07.615986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:07.616746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:07.617185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:07.749231 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:07.756554 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1fac0193-ee05-481c-8f0e-3f76ae5fb366 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1265 microversion: 2.1 time: 0.151930 May 13 21:54:07.757201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 179/332] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:07 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:07.907167 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:07.907757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:07.913816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:07.914262 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:07.915046 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:07.915476 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.044267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:08.052326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:08.053840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:08.055020 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b238697c-a6a3-4323-bc4e-9504c905571c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1722 microversion: 2.20 time: 0.152299 May 13 21:54:08.055579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 154/333] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:07 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:08.074905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eac51ae-bc06-4ae3-b81f-134bdc89bf31"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:08.076900 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:08.083258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.083790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.084626 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.085131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.352004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cf718403-22b5-4bd1-94c8-47788c3b44a1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282137 May 13 21:54:08.352604 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 180/334] 10.222.0.35 () {62 vars in 1363 bytes} [Fri May 13 21:54:08 2022] POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:54:08.443400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2866fa1e-ed1b-406c-b858-6c705abd479a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: .version_select at 0x7fb7d774b0d0>, body: {"keypair": {"name": "tempest-keypair-92307404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4BVJ8Gi9AyAhKtXFOqwY1cEFNcuhnGx46e4Drgz6UQq6y4HsWE1SwT+slZsDjgAs8jAgoRoCXFEUWXueOrsny6v00iMHk0ygA/Hqxic4DwBNfn80HX6xmb+5fV5DmAWQ=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:08.469530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-2866fa1e-ed1b-406c-b858-6c705abd479a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for project 428d047f511945e5bdf35eb8ed236507. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:54:08.471698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-2866fa1e-ed1b-406c-b858-6c705abd479a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for user 6b11a3de8b71482594a04ab7e53a94bd and project 428d047f511945e5bdf35eb8ed236507. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:54:08.478578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:08.479264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:08.488044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.489511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.490249 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.490689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.531099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2866fa1e-ed1b-406c-b858-6c705abd479a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.091169 May 13 21:54:08.535937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 155/335] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:54:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:08.623137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cf1f729f-48dc-48e0-a147-6d8c162a2bb7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/action" status: 202 len: 0 microversion: 2.20 time: 0.148107 May 13 21:54:08.627804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 181/336] 10.222.0.35 () {62 vars in 1318 bytes} [Fri May 13 21:54:08 2022] POST /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 21:54:08.635036 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:08.635658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:08.642649 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.643145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.644144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.644593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.775359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:08.776182 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:08.786531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.787014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:08.787800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:08.796754 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:09.057587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:09.074643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:09.083906 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:09.087672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b79549ac-6db3-488a-8765-20892262f16c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1748 microversion: 2.20 time: 0.456913 May 13 21:54:09.090442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 156/337] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:08 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1748 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:09.164369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:09.197208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-25081bf6-1eff-461a-898b-288f1aa0a09e tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1452 microversion: 2.1 time: 0.421117 May 13 21:54:09.211349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 182/338] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:08 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1452 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:09.221058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:09.221825 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:09.252077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:09.252548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:09.253353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:09.253793 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:09.672393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:09.681167 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6cc738a3-25d8-4cff-8f1c-b9b6ad4c4ad2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1452 microversion: 2.1 time: 0.469205 May 13 21:54:09.684309 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 157/339] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:09 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1452 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:10.119036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:10.120001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:10.137370 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:10.137832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:10.138981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:10.140102 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:10.543159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:10.552642 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:10.554141 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:10.555314 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f3a36802-576c-4270-875f-41d5b98bd6a8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1748 microversion: 2.20 time: 0.449440 May 13 21:54:10.556197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 183/340] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:10 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1748 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:11.441051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1265121734", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90541eb1-b174-4a95-af44-3c1eff2260dd"}], "security_groups": [{"name": "tempest-securitygroup--483127770"}], "key_name": "tempest-keypair-92307404", "user_data": "}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:11.555648 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] validate_networks() for [('90541eb1-b174-4a95-af44-3c1eff2260dd', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:54:11.575413 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:11.577787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:11.586239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:11.587039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:11.588563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:11.589213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:11.805634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:11.815157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:11.816568 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:11.817741 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-58182725-f1e0-49cf-9830-c5df0bb9aad7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1748 microversion: 2.20 time: 0.247575 May 13 21:54:11.818446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 184/341] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:11 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1748 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:12.016182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:54:12.016681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:54:12.017234 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:54:12.017715 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:54:12.018250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:54:12.027081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:12.027621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:12.028491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:12.029038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:12.047094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:54:12.051735 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Getting quotas for user 6b11a3de8b71482594a04ab7e53a94bd and project 428d047f511945e5bdf35eb8ed236507. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:54:12.063484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:54:12.065786 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:54:12.112738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-121e7dee-3be9-483e-b4c7-714165d677d7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.675818 May 13 21:54:12.113763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 158/342] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:54:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:54:12.124655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-83ff4f16-9f5c-4a11-ac67-0d29e5a64f63 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:12.125845 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-83ff4f16-9f5c-4a11-ac67-0d29e5a64f63 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:12.197971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-83ff4f16-9f5c-4a11-ac67-0d29e5a64f63 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:12.204656 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-83ff4f16-9f5c-4a11-ac67-0d29e5a64f63 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1244 microversion: 2.1 time: 0.084694 May 13 21:54:12.205224 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 185/343] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:12 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:12.838032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:12.846333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:12.857029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:12.857667 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:12.858672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:12.859313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:13.050288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:13.059672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:13.065726 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:13.069137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-16250939-43a3-4233-9017-4152154b2fba tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1750 microversion: 2.20 time: 0.235513 May 13 21:54:13.078698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 159/344] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:12 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:13.222944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:13.224685 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:13.232212 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:13.232673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:13.245727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:13.246314 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:13.393564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:13.405697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1f158335-58d2-435b-9648-63fa17956d55 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1296 microversion: 2.1 time: 0.186400 May 13 21:54:13.413012 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 186/345] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:13 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1296 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:13.512832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-e48775ee-472d-4cb7-95de-8460658bf375 req-429c5940-99ab-4c18-9d1e-1c9823d5259c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c1fa86-0199-416e-906e-ecbb3d1e510f", "tag": "c4df6d51-ad13-478c-b857-3f2949f60980"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:13.528732 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-e48775ee-472d-4cb7-95de-8460658bf375 req-429c5940-99ab-4c18-9d1e-1c9823d5259c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:13.532856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-e48775ee-472d-4cb7-95de-8460658bf375 req-429c5940-99ab-4c18-9d1e-1c9823d5259c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:13.568012 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-e48775ee-472d-4cb7-95de-8460658bf375 req-429c5940-99ab-4c18-9d1e-1c9823d5259c service nova] Creating event network-changed:c4df6d51-ad13-478c-b857-3f2949f60980 for instance 95c1fa86-0199-416e-906e-ecbb3d1e510f on hv-cinder-84051 May 13 21:54:13.583957 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-e48775ee-472d-4cb7-95de-8460658bf375 req-429c5940-99ab-4c18-9d1e-1c9823d5259c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072899 May 13 21:54:13.585424 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 160/346] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:14.093968 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:14.094869 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:14.118197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:14.118943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:14.121670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:14.124576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:14.427087 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:14.427756 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:14.440769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:14.443392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:14.444722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:14.446690 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:14.711342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:14.741578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5de31c6b-7fc2-48c5-b82d-24e739bccae9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1302 microversion: 2.1 time: 0.317327 May 13 21:54:14.744112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 161/347] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:14 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1302 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:15.328400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:15.348912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:15.354988 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:15.359913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-85be4b78-98a8-4d20-82c8-934fbc555b2c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1750 microversion: 2.20 time: 1.270761 May 13 21:54:15.365158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 187/348] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:14 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1750 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:15.770992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:15.770992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:15.796444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:15.798197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:15.798197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:15.798551 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:15.996019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:16.014630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-76887488-29dd-438a-9940-a9561e9c7793 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1302 microversion: 2.1 time: 0.258778 May 13 21:54:16.028251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 162/349] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:15 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1302 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:16.382659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:16.383298 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:16.396273 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:16.409490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:16.412479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:16.413184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:17.035454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:17.036908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:17.055860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:17.057024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:17.061010 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:17.065759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:17.992498 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:18.061426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:18.062948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:18.064148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e9d9122d-1fa3-4a9e-83ae-d91f71f6c75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 1.685583 May 13 21:54:18.064760 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 188/350] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:16 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:18.321560 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:18.329448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-45fb9c35-c87a-4037-8108-07a4053373b2 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 1.300785 May 13 21:54:18.353586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 163/351] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:17 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:18.855307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-bfa4ef09-e8c6-4f23-924b-a8193ee6fcde req-6f29d87c-5fe4-48b8-9a6b-435750bfbba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:18.876348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-bfa4ef09-e8c6-4f23-924b-a8193ee6fcde req-6f29d87c-5fe4-48b8-9a6b-435750bfbba7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:18.876837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-bfa4ef09-e8c6-4f23-924b-a8193ee6fcde req-6f29d87c-5fe4-48b8-9a6b-435750bfbba7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:18.911449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-bfa4ef09-e8c6-4f23-924b-a8193ee6fcde req-6f29d87c-5fe4-48b8-9a6b-435750bfbba7 service nova] Creating event network-changed:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:54:18.940895 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-bfa4ef09-e8c6-4f23-924b-a8193ee6fcde req-6f29d87c-5fe4-48b8-9a6b-435750bfbba7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091066 May 13 21:54:18.946850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 189/352] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:54:19.082693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:19.083999 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:19.112529 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:19.112912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:19.114158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:19.114604 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:19.358446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:19.359120 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:19.373935 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:19.387781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:19.389644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:19.394625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:19.662427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:19.664680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:19.673940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b32d4b63-2051-48e9-a004-17438f563b5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.320094 May 13 21:54:19.676895 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 190/353] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:19 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:19.686071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:19.687054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:19.688242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-72ff8ee8-ffc6-4231-a520-6b26ac207f09 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.610045 May 13 21:54:19.702484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 164/354] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:19 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:20.694731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:20.695552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:20.706622 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:20.707989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:20.724221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:20.724910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:20.733599 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:20.733957 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:20.734447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:20.740519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:20.746185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:20.752692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:21.211166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:21.220740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-97f3f018-2445-442d-8cb8-f91e5b380a6f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.530560 May 13 21:54:21.221296 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 191/355] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:20 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:21.235014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1712447332", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:21.263569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:21.279703 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:21.281903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:21.284151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fbe8aa5e-cef8-4fa7-a368-bf47fab02749 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.582429 May 13 21:54:21.285460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 165/356] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:20 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:22.239789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:22.241307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:22.249121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:22.249628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:22.250690 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:22.254360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:22.471608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:22.481048 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a778f4fb-99c5-4c56-b927-853f4c41d406 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.246266 May 13 21:54:22.485001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 166/357] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:22 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:22.503844 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:22.505023 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:22.514467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:22.515222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:22.516181 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:22.516783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:22.716348 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:22.733406 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:22.735434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:22.736904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b53594fa-71e1-4371-a2c0-aaddbc513435 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.250686 May 13 21:54:22.738482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 167/358] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:22 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:23.503609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:23.505104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:23.521840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:23.523024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:23.524425 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:23.525325 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:23.740874 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:23.749769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9b9e45a3-b24e-4a71-a490-0b5d1b5d4088 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.251964 May 13 21:54:23.750528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 168/359] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:23 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:23.763836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:23.764774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:23.786931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:23.787396 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:23.788999 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:23.789614 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:24.031466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:24.049796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:24.051915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:24.053592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1c98d53d-091d-487b-8788-eea34fe1760e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.301279 May 13 21:54:24.054777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 169/360] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:23 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:24.771044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:24.772376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:24.780945 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:24.781757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:24.782824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:24.783521 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:25.049313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:25.062159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b07c6238-308c-4b0d-9440-47d020c9b389 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.299657 May 13 21:54:25.073024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 170/361] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:24 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:25.078684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:25.083546 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:25.103568 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:25.105275 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:25.109536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:25.110200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:25.391445 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:25.410123 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:25.416443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:25.421303 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b35fa35d-2330-49bd-aefc-dd555a4a4247 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.352258 May 13 21:54:25.422846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 171/362] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:25 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:25.762028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-963c064f-f6a4-4f99-97fc-037ea77be150 req-1f703231-555b-4bba-8531-4145a60b77a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "name": "network-vif-plugged", "status": "completed", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:25.778971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-963c064f-f6a4-4f99-97fc-037ea77be150 req-1f703231-555b-4bba-8531-4145a60b77a7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:25.787647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-963c064f-f6a4-4f99-97fc-037ea77be150 req-1f703231-555b-4bba-8531-4145a60b77a7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:25.818031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-963c064f-f6a4-4f99-97fc-037ea77be150 req-1f703231-555b-4bba-8531-4145a60b77a7 service nova] Creating event network-vif-plugged:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:54:25.832250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-963c064f-f6a4-4f99-97fc-037ea77be150 req-1f703231-555b-4bba-8531-4145a60b77a7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073511 May 13 21:54:25.836611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 172/363] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:26.081145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:26.081960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:26.094342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:26.095208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:26.096249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:26.097701 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:26.467107 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:26.477719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a3ab17e5-7c19-41f8-b8ed-24d84009ad5d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.398718 May 13 21:54:26.479524 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 173/364] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:26 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:26.491486 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:26.492487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:26.498768 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:26.499536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:26.500553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:26.501212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:27.073915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:27.086247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:27.089331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:27.090967 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3702fd0f-20e3-4b7b-b2c2-350ff056fed0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.610197 May 13 21:54:27.092116 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 174/365] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:26 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:27.495923 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:27.496540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:27.503737 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:27.504190 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:27.505190 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:27.507155 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:27.753408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:27.762159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8995a932-6123-494b-970b-dcf6f0cd2e89 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1369 microversion: 2.1 time: 0.270738 May 13 21:54:27.763634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 175/366] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:27 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:28.109736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:28.110392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:28.125351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:28.126242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:28.127462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:28.128142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:28.778168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:28.787647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:28.801080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:28.804833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a58dbc4b-d96c-48e4-b6f7-e0263afba7a4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.699342 May 13 21:54:28.807941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 176/367] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:28 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:28.815679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:28.836806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:28.847527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:28.870273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:28.871603 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:28.872246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:29.329526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:29.341857 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3ac32785-f5b1-4390-9040-b49af903adb3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1563 microversion: 2.1 time: 0.525922 May 13 21:54:29.343658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 177/368] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:28 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1563 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:29.361720 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:29.362572 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:29.384431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:29.390021 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:29.390911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:29.400069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:29.648083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8fafe747-e3d9-40de-b473-f351c0ecd56a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.291002 May 13 21:54:29.655153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 178/369] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 21:54:29 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-interface => generated 285 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:54:29.830200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:29.830795 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:29.859357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:29.862330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:29.865898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:29.870371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:30.244326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:30.270165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:30.276613 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:30.286837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3d457f91-db32-4f94-a214-16fdcbb8d839 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.462948 May 13 21:54:30.288586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 179/370] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:29 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:31.313530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:31.314809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:31.342862 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:31.344166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:31.348304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:31.351725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:31.725200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:31.745764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:31.750211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:31.761117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ce9afd8e-5ad8-47ae-b634-acb04d235c9d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.455920 May 13 21:54:31.761713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 180/371] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:31 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:31.767842 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-96579f9a-03b6-4d4d-a962-bff3ace2fe68 req-215a0cd6-9ef4-4b3e-9e1b-9b44630a42ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:31.798012 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-96579f9a-03b6-4d4d-a962-bff3ace2fe68 req-215a0cd6-9ef4-4b3e-9e1b-9b44630a42ef service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:31.798848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-96579f9a-03b6-4d4d-a962-bff3ace2fe68 req-215a0cd6-9ef4-4b3e-9e1b-9b44630a42ef service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:31.816787 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-96579f9a-03b6-4d4d-a962-bff3ace2fe68 req-215a0cd6-9ef4-4b3e-9e1b-9b44630a42ef service nova] Creating event network-changed:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:54:31.824206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-96579f9a-03b6-4d4d-a962-bff3ace2fe68 req-215a0cd6-9ef4-4b3e-9e1b-9b44630a42ef service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059016 May 13 21:54:31.825468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 181/372] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:32.783050 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:32.784089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:32.819824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:32.823793 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:32.831330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:32.834288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:32.984068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] validate_networks() for None {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:54:34.111150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:34.128346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:34.134377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:34.136648 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9582c72f-2586-4877-857a-9ab74a239a45 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 1.360267 May 13 21:54:34.141287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 182/373] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:32 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:34.170832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:54:34.171315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:54:34.171712 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:54:34.172114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:54:34.172524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:54:34.190929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:34.192605 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:34.194077 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:34.194691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:34.227166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Getting quotas for project a480dd328dbc461690b7a80095a21967. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:54:34.233403 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Getting quotas for user 75a06208154149a88ca10d30520a58d5 and project a480dd328dbc461690b7a80095a21967. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:54:34.248811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:54:34.253376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:54:34.329946 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8ab70094-1f60-4af2-b412-513c1fbdc5ed tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.107242 May 13 21:54:34.331465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 192/374] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 13109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:54:34.342228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dd831873-7bf1-4184-b25e-a422d387035d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:34.342846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-dd831873-7bf1-4184-b25e-a422d387035d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:34.519801 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-dd831873-7bf1-4184-b25e-a422d387035d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:34.528014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-dd831873-7bf1-4184-b25e-a422d387035d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1215 microversion: 2.1 time: 0.190603 May 13 21:54:34.539996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 183/375] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:34 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:35.179549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:35.180116 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:35.245667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:35.249038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:35.250439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:35.251964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:35.551209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:35.552415 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:35.572256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:35.573087 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:35.575519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:35.576704 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:35.651057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:35.673396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:35.675251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:35.676649 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-491983ef-2727-4494-8ef8-820895e9bf57 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.523561 May 13 21:54:35.689595 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 193/376] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:35 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:35.751226 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:35.760618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1e4a9bc9-8351-45b0-9314-d6fb4a330791 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1219 microversion: 2.1 time: 0.218104 May 13 21:54:35.772992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 184/377] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:35 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:36.696981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:36.697610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:36.728593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:36.732202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:36.733104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:36.733561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:36.785214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:36.786011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:36.800154 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:36.803441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:36.804716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:36.811239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:37.056388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:37.064937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bb9de1df-2b85-4b14-b737-942281b99234 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1275 microversion: 2.1 time: 0.288963 May 13 21:54:37.072516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 185/378] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:36 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:37.190733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:37.202165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:37.220796 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:37.222031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2ab3b8ca-434a-401b-8bdf-4163da7a3ae4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.529042 May 13 21:54:37.236948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 194/379] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:36 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:38.083262 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:38.083848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:38.090256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:38.095865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:38.096911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:38.097446 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:38.232575 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:38.244151 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:38.244759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:38.255214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:38.257726 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-684f425f-8dbf-44cc-816f-c078754221c8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1273 microversion: 2.1 time: 0.178340 May 13 21:54:38.258362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:38.259361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:38.260117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 186/380] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:38 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:38.260864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:38.588800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:38.615259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:38.620409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:38.627144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-76282518-5557-4f58-905b-1d4f1b900fe8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.386610 May 13 21:54:38.645334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 195/381] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:38 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:39.276819 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:39.277427 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:39.291068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:39.291779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:39.292762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:39.300164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:39.566550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:39.573942 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9db41feb-b49c-4e3c-8451-78a6acea31c3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.300838 May 13 21:54:39.576153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 187/382] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:39 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:39.656956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:39.658291 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:39.672226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:39.672226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:39.673606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:39.675174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:39.879053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-83436640-f39a-4b9d-ae81-c422f8cde7e7 req-4ce161c2-f589-4615-967b-2cf3e873c026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088c5aa6-3b49-4691-bdf5-b95a4d1a8456", "tag": "2ee29915-e8f4-4613-8c77-02fb7349c44e"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:39.903377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-83436640-f39a-4b9d-ae81-c422f8cde7e7 req-4ce161c2-f589-4615-967b-2cf3e873c026 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:39.903963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-83436640-f39a-4b9d-ae81-c422f8cde7e7 req-4ce161c2-f589-4615-967b-2cf3e873c026 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:39.939696 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-83436640-f39a-4b9d-ae81-c422f8cde7e7 req-4ce161c2-f589-4615-967b-2cf3e873c026 service nova] Creating event network-changed:2ee29915-e8f4-4613-8c77-02fb7349c44e for instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 on hv-cinder-84051 May 13 21:54:39.949960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-83436640-f39a-4b9d-ae81-c422f8cde7e7 req-4ce161c2-f589-4615-967b-2cf3e873c026 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072976 May 13 21:54:39.959122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 188/383] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:40.060402 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:40.089723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:40.105975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:40.108986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c3f61d8f-87b1-45e9-a18f-7c503fe1af5a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.459965 May 13 21:54:40.111493 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 196/384] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:39 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:40.596754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:40.598327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:40.619033 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:40.619740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:40.620722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:40.626668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:41.017624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:41.025478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7417158e-7a86-44ff-875c-a7fe30cf20a8 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.435992 May 13 21:54:41.026071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 189/385] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:40 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:41.140076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:41.140705 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:41.150398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:41.154194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:41.161296 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:41.161756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:41.401430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:41.412025 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:41.414392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:41.416031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-953e352a-fc99-4db7-b0f4-bb8ab8313b34 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.280890 May 13 21:54:41.417483 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 197/386] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:41 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:42.055658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:42.057014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:42.063776 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:42.066278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:42.067360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:42.068008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:42.252741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:42.260880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0ca41ba9-454f-41a9-8664-1eb8972f9119 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.209892 May 13 21:54:42.276617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 190/387] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:42 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:42.437128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:42.440873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:42.448365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:42.449006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:42.450569 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:42.451332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:42.612062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:42.622410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:42.624238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:42.625644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e581fb02-4346-429a-bc9d-c637f17f6c4f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.193152 May 13 21:54:42.626688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 198/388] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:42 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:43.286983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:43.287762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:43.298413 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:43.299309 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:43.300304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:43.300967 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:43.459431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:43.474356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a0ee18c0-811d-4017-9c49-7708d7e9a3fc tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.191486 May 13 21:54:43.475976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 191/389] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:43 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:43.652309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:43.654249 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:43.661926 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:43.662626 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:43.663604 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:43.664201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:43.914787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:43.937676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:43.939602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:43.940991 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-18f9ae1d-2aca-4466-8d24-dfe78bb2f75b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.293462 May 13 21:54:43.941927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 199/390] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:43 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:44.498987 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:44.500943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:44.509689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:44.510541 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:44.511560 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:44.512198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:44.696834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:44.705251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-96dc4ac8-c75f-41f2-8a6c-36a1945a1186 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.216153 May 13 21:54:44.706603 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 192/391] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:44 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:44.960380 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:44.961731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:44.970721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:44.971598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:44.973128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:44.975465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:45.200908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:45.214517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:45.214517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:45.214517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cf2f3d30-ead6-4e20-9a4b-f6e53a5fc198 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.257030 May 13 21:54:45.219085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 200/392] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:44 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:45.723225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:45.723842 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:45.736988 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:45.737447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:45.738482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:45.751915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:45.946007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:45.957737 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-76f8ca2e-b64f-45a7-a194-b0a9d0a94c70 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.239254 May 13 21:54:45.969267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 193/393] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:45 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:46.231699 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:46.232973 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:46.248350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:46.249446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:46.251148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:46.252041 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:46.427989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:46.439158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:46.440811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:46.441899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2b1c1a99-d091-4291-ac7a-0279f33733e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.214236 May 13 21:54:46.455020 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 201/394] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:46 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:46.975402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:46.976013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:46.983485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:46.983955 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:46.984769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:46.985201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:47.124608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-19428b01-9f37-4c87-ae3a-ae4075ba0c78 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'create', calling method: .version_select at 0x7fb7d66e4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1248043653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXmdur+iNRsEZp86HT5Q9HJi9Ud8aZYpAxjdSuBWv2JE7kQkNq8SdgPJFx1egnhC86XT5MR7NOL4UVYsslXcku8YNHyF2HJe5cwpfDYYyTTn5cEdT5T+c00Fu3MzPdaBA=="}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:47.137628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:47.145965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4b1d31a4-1ab6-446d-b810-d69cb24b398f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.174532 May 13 21:54:47.146698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 194/395] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:46 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:47.163179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-19428b01-9f37-4c87-ae3a-ae4075ba0c78 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Getting quotas for project d37b24e8a85f49ce9d043e8a38b8748f. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:54:47.167698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-19428b01-9f37-4c87-ae3a-ae4075ba0c78 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Getting quotas for user 4812f8677a754dcd9e7a5607c643e8cb and project d37b24e8a85f49ce9d043e8a38b8748f. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:54:47.197643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-19428b01-9f37-4c87-ae3a-ae4075ba0c78 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.077597 May 13 21:54:47.198447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 202/396] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:54:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:54:47.248688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1136726101", "imageRef": "6eaa6919-d4a2-4a47-9647-5ad2d05868cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1248043653", "networks": [{"uuid": "d8a04cb7-482e-4b3e-afb7-f6138da57554"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:47.307171 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] validate_networks() for [('d8a04cb7-482e-4b3e-afb7-f6138da57554', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:54:47.462113 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:47.462754 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:47.468650 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:47.469098 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:47.469863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:47.470300 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:47.685215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:47.694828 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:47.696719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:47.697952 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-66ba5821-b767-4e47-8b39-44a7e5ea24dc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.239794 May 13 21:54:47.698599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 203/397] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:47 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:47.785508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:54:47.786053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:54:47.786522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:54:47.787121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:54:47.787473 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:54:47.796533 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:47.796971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:47.797757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:47.798186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:47.818145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Getting quotas for project d37b24e8a85f49ce9d043e8a38b8748f. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:54:47.822880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Getting quotas for user 4812f8677a754dcd9e7a5607c643e8cb and project d37b24e8a85f49ce9d043e8a38b8748f. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:54:47.835826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:54:47.838231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6eaa6919-d4a2-4a47-9647-5ad2d05868cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:54:47.901205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-48aa2826-bc44-4ac2-a3c0-12f5d82e447a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657154 May 13 21:54:47.902453 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 195/398] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 21:54:47.912156 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f86a17d3-87e5-4f8a-8197-fe6073d13476 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:47.912776 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f86a17d3-87e5-4f8a-8197-fe6073d13476 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:47.997660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f86a17d3-87e5-4f8a-8197-fe6073d13476 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:48.009118 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f86a17d3-87e5-4f8a-8197-fe6073d13476 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1259 microversion: 2.1 time: 0.100633 May 13 21:54:48.010312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 204/399] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:47 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1259 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:48.166620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:48.167222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:48.173913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:48.174442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:48.175303 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:48.175810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:48.392442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:48.404003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-68cc966d-afda-44f9-bcf3-01407d35cae3 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.241251 May 13 21:54:48.404609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 196/400] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:48 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:48.716862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:48.718176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:48.737058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:48.737509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:48.738561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:48.739078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:48.885089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:48.893854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:48.895389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:48.896576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b9666f87-eac8-433d-8832-4d30df5c772e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.183684 May 13 21:54:48.897132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 205/401] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:48 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:49.025520 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:49.026134 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:49.033809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.034215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:49.035511 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.035952 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:49.097923 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:49.105388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7395f5f3-23ed-465a-9d8c-a6a190591c0a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1263 microversion: 2.1 time: 0.083748 May 13 21:54:49.106277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 197/402] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:49 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:49.421947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:49.422485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:49.428521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.429080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:49.429840 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.430400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:49.591965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:49.599311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6c65dd20-c227-4da7-bb35-f2f36482b60b tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.182155 May 13 21:54:49.599888 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 206/403] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:49 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:49.918479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:49.919221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:49.925278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.925809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:49.926655 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:49.927195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:50.130429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:50.131103 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:50.134247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:50.141108 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:50.141915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:50.142347 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:50.142821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:50.143943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:50.145539 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:50.147053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-af1d22fc-e1f7-474a-b81d-d7b65b6295dd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.234657 May 13 21:54:50.159411 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 198/404] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:49 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:50.223730 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:50.234832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e9626058-7ec8-42e1-aeab-dba8ce035ac9 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1263 microversion: 2.1 time: 0.109309 May 13 21:54:50.236101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 207/405] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:50 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1263 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:50.618986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:50.619602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:50.633100 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:50.633580 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:50.634482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:50.635018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:50.821950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:50.831479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d1b22cf7-d798-434d-9a30-264fc671270c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.216154 May 13 21:54:50.832120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 199/406] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:50 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:51.169494 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:51.173517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:51.181812 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.182461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:51.183274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.183705 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:51.254201 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:51.255914 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:51.279779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.280533 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:51.281612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.282335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:51.368142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:51.382840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-05f514d4-2eb0-4d23-8ccc-5824ad0961e8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1263 microversion: 2.1 time: 0.131160 May 13 21:54:51.392391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 200/407] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:51 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:51.395068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:51.406761 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:51.407595 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:51.409267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-676d316c-cc50-4155-87d9-e28aebaf03cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.247061 May 13 21:54:51.421210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 208/408] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:51 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:54:51.850301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:51.851042 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:51.857838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.858365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:51.859236 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:51.859794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:52.004795 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:52.011909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0c084a3a-9d52-4a35-8c44-158aed1c8095 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.165464 May 13 21:54:52.012995 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 201/409] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:51 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:52.399811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:52.400426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:52.408192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:52.408703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:52.409471 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:52.409938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:52.429204 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:52.430647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:52.437775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:52.438654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:52.439561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:52.440062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:52.496024 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:52.506369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ce506ee9-f3b8-4e87-92e5-670545c960fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1263 microversion: 2.1 time: 0.110396 May 13 21:54:52.507000 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 209/410] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:52 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1263 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:52.615396 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:52.624380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:52.626344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:52.627655 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6608d8d8-5a47-47de-9a01-b98f59c2d56a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.203031 May 13 21:54:52.628207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 202/411] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:52 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:53.029238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:53.029856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:53.036673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.037138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.038698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.039264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.194351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:53.202171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-16b6e2bb-2a68-48bf-8c94-1a86d05654dd tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.177000 May 13 21:54:53.202761 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 210/412] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:53 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:53.523242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:53.523848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:53.529705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.530147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.531028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.531532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.592068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:53.599216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2044cff2-2738-4a34-9576-3508b933af05 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1263 microversion: 2.1 time: 0.079967 May 13 21:54:53.599783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 203/413] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:53 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:53.649545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:53.650157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:53.668474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.669615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.674124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:53.674124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:53.807551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:53.816649 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:53.818157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:53.819372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ee6f26a1-28b0-4672-b079-cb70e28b8a72 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.175380 May 13 21:54:53.819928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 211/414] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:53 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:54.219974 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:54.221157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:54.228113 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.228635 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.229478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.229981 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.402770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:54.421835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-69eff82e-373b-496d-879d-d46c0bc288be tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.206133 May 13 21:54:54.430617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 204/415] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:54 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:54.616572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:54.617176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:54.623758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.624206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.624959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.625393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.686246 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:54.693652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ef860360-cbc6-4817-85ea-1667328a3753 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1255 microversion: 2.1 time: 0.081164 May 13 21:54:54.694226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 212/416] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:54 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:54.837310 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:54.837903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:54.843755 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.844209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.844971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:54.845408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:54.976295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:54.984911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:54.986391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:54.987555 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-869295b8-419d-4710-b7f4-13cb873de75a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.154175 May 13 21:54:54.988360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 205/417] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:54 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:55.440873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:55.441850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:55.449061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:55.449535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:55.450371 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:55.451649 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:55.613380 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:55.620523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8a2f40be-c826-44c1-a22d-612a3462d013 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.184157 May 13 21:54:55.621079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 213/418] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:55 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:55.711833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:55.712436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:55.718337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:55.719165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:55.720103 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:55.720701 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:55.782203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:55.789346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fc581fc3-e1c1-49e7-8ab5-c9334e78f5b1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1311 microversion: 2.1 time: 0.081488 May 13 21:54:55.789911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 206/419] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:55 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:56.007988 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:56.008993 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:56.016160 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.016953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.017782 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.018249 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.159016 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:56.167269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:56.168756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:56.170466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f80fb5bc-f8f6-4b1a-921a-e14324251d3c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.167744 May 13 21:54:56.171155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 214/420] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:56 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:56.638876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:56.640972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:56.647610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.648177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.649208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.649748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.807383 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:56.808052 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:56.808692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:56.816075 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f448b77d-3339-4ea6-a5de-946f07b7b376 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.181352 May 13 21:54:56.816654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 207/421] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:56 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:56.819136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.819822 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.821195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:56.821850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:56.895475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:56.902958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5da08206-d068-493f-8e09-d5b9addd900f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1317 microversion: 2.1 time: 0.100224 May 13 21:54:56.912932 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 215/422] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:56 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:57.192033 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:57.197763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:57.212440 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.214251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:57.215183 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.215637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:57.409695 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:57.422149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:57.424741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:57.426274 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ed18ae32-0abe-4593-92e8-aaba246c6686 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.240892 May 13 21:54:57.439020 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 208/423] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:57 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:57.832813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:57.833436 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:57.840175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.840848 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:57.841711 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.842148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:57.921080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:57.922057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:57.928852 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.929456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:57.930390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:57.930866 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:58.078922 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:58.102321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8a4c0c48-e7d7-4812-8a01-075298023ba9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.269565 May 13 21:54:58.109838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 216/424] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:57 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:58.205242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:58.219722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-569f6055-83e7-4df3-aafe-7979ffcdcc32 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.302482 May 13 21:54:58.220853 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 209/425] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:57 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:54:58.446964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:58.448119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:58.457047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:58.457494 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:58.458269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:58.458723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:58.718929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:58.732444 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:58.736996 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:58.737688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-40954da9-75b2-4f79-bd54-e79db23a68e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.295918 May 13 21:54:58.740873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 217/426] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:58 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:54:59.117082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:59.117621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:59.123960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.124517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.125170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.125600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.237377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:59.239465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:59.264100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.265001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.266218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.266913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.314409 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:59.324178 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-17da4a83-8794-418e-a630-c003eee0b7fa tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.211346 May 13 21:54:59.324759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 210/427] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:59 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:59.543972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-c6aa2e96-5957-4b75-922a-8b58573932e1 req-94c8b1c4-193f-4b10-a15f-2a6d2855dc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088c5aa6-3b49-4691-bdf5-b95a4d1a8456", "name": "network-vif-plugged", "status": "completed", "tag": "2ee29915-e8f4-4613-8c77-02fb7349c44e"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:54:59.565227 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c6aa2e96-5957-4b75-922a-8b58573932e1 req-94c8b1c4-193f-4b10-a15f-2a6d2855dc0b service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.566195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c6aa2e96-5957-4b75-922a-8b58573932e1 req-94c8b1c4-193f-4b10-a15f-2a6d2855dc0b service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.581945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:59.583896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-c6aa2e96-5957-4b75-922a-8b58573932e1 req-94c8b1c4-193f-4b10-a15f-2a6d2855dc0b service nova] Creating event network-vif-plugged:2ee29915-e8f4-4613-8c77-02fb7349c44e for instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 on hv-cinder-84051 May 13 21:54:59.593933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-c6aa2e96-5957-4b75-922a-8b58573932e1 req-94c8b1c4-193f-4b10-a15f-2a6d2855dc0b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053982 May 13 21:54:59.595022 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 211/428] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:54:59.599824 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e042e855-d04e-41a5-8f8c-9304da30d93a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.366908 May 13 21:54:59.600928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 218/429] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:54:59 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:54:59.757811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:54:59.758498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:54:59.769491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.769943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.770738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:54:59.771273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:54:59.965508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:59.977210 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:59.982893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:54:59.984516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e52ec3a2-02b3-4024-afcb-c35b4b6e14aa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.230982 May 13 21:54:59.985216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 212/430] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:54:59 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:00.343178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:00.344574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:00.352145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:00.352808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:00.353790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:00.354302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:00.532673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:00.542355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3752623e-9792-445e-8e85-546ef490b47d tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.204687 May 13 21:55:00.542981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 219/431] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:00 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:00.691845 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:00.692452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:00.698523 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:00.699965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:00.701668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:00.702352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:00.853689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:00.861133 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f18dede7-e7c0-4d53-ab0e-044941f4989b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.173558 May 13 21:55:00.861705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 213/432] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:00 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:01.002342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:01.002896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:01.008896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.009372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:01.010128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.010558 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:01.143637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:01.151808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:01.153292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:01.154457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0386dee8-a50f-4613-b63a-921c444e0275 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.156017 May 13 21:55:01.155422 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 220/433] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:00 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:01.561249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:01.562161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:01.568584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.569289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:01.570232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.570854 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:01.757342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:01.780997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f825a8fc-a1a2-4080-9ed7-059fd768f829 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.224538 May 13 21:55:01.799023 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 214/434] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:01 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:01.879770 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:01.881449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:01.890227 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.890698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:01.891512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:01.891953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:02.044758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:02.052080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-70bfc8ec-981b-448a-9499-75c9753d35c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.177409 May 13 21:55:02.052650 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 221/435] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:01 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:02.173718 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:02.174456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:02.181314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:02.181774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:02.182663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:02.183262 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:02.357249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:02.369626 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:02.371428 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:02.372859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7865fe1e-d430-4761-aad9-703e34ccd0a5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.203507 May 13 21:55:02.373855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 215/436] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:02 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:02.802698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:02.803339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:02.812106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:02.812550 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:02.813317 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:02.813747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:02.979337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:02.989287 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e07c79a6-d634-4a08-88f1-e1bc2c70aa0c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.190317 May 13 21:55:03.000195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 222/437] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:02 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:03.069113 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:03.069739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:03.076770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:03.077313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:03.087772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:03.088354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:03.253985 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:03.268267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-07d7c98e-cabb-4ac4-bf02-db74f7e0d6f8 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.203092 May 13 21:55:03.269171 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 216/438] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:03 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:03.392668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:03.393386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:03.400409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:03.401407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:03.402983 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:03.404175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:03.555863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:03.564484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:03.566229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:03.567523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-03834471-3f1d-4694-a819-226677a01f66 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.180183 May 13 21:55:03.579474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 223/439] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:03 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:55:04.007058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:04.007812 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:04.014517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.014997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.016064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.016739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.174561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:04.183559 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-56d48156-959a-4497-b3b2-2ba5162dfe93 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.180137 May 13 21:55:04.185305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 217/440] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:04 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:04.285783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:04.286354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:04.292588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.293032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.293788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.294225 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.437985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:04.445416 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9216fcd1-2f54-403c-bbfc-ef06166ace2f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.163671 May 13 21:55:04.446438 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 224/441] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:04 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:04.586918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:04.587950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:04.597875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.598864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.601741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:04.602191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:04.783643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:04.801312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:04.803305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:04.804775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-27c3940e-40cc-4371-9751-b75856e697a6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.222054 May 13 21:55:04.816648 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 218/442] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:04 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:05.201821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:05.202809 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:05.209087 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.209681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.210548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.211078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.471540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:05.479383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:05.482273 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:05.495622 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.497762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.500110 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.500598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-10fc3149-14e6-49cf-90b8-a19010bc3256 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.301389 May 13 21:55:05.501479 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 225/443] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:05 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:05.502037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.670558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:05.677739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9d24ff6d-5eb3-4642-9ed8-4fb71e0ce540 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.210018 May 13 21:55:05.678305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 219/444] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:05 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:05.824014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:05.824625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:05.831180 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.831638 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.832401 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:05.832839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:05.963092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:05.971546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:05.973017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:05.974155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4f4ec87d-7f97-4088-a1cd-7eb507619e5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.154355 May 13 21:55:05.974738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 226/445] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:05 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:06.521785 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:06.523041 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:06.530920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:06.530920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:06.530920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:06.531203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:06.659257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:06.668024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6b30ebeb-02e6-4548-8694-6026176c3385 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.149977 May 13 21:55:06.668593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 220/446] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:06 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:06.695290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:06.695977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:06.702850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:06.703366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:06.704185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:06.704619 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:06.858158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:06.866179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-73e9d4a2-595b-48dc-ad3f-87b6218bfc5c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.174286 May 13 21:55:06.866944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 227/447] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:06 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:06.992974 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:06.993576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:06.999435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:06.999882 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.000633 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.001369 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.137256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:07.146626 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:07.148165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:07.149514 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6b0bdc02-8cec-4f4e-afae-6a7075d7079a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.160275 May 13 21:55:07.150298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 221/448] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:06 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:07.461028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-52719fc7-4246-4cf8-838b-d44bfde39674 req-4bc5c5d9-7b6d-47be-b4c7-f4794368d425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:07.469559 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-52719fc7-4246-4cf8-838b-d44bfde39674 req-4bc5c5d9-7b6d-47be-b4c7-f4794368d425 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.470250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-52719fc7-4246-4cf8-838b-d44bfde39674 req-4bc5c5d9-7b6d-47be-b4c7-f4794368d425 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.483304 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-52719fc7-4246-4cf8-838b-d44bfde39674 req-4bc5c5d9-7b6d-47be-b4c7-f4794368d425 service nova] Creating event network-changed:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:55:07.488456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-52719fc7-4246-4cf8-838b-d44bfde39674 req-4bc5c5d9-7b6d-47be-b4c7-f4794368d425 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030958 May 13 21:55:07.489044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 228/449] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:07.687259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:07.687802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:07.694225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.694681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.695509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.695950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.881387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:07.883290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:07.884535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:07.891529 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3752ab53-2a4e-4fda-9445-5a5c9c1d027c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.209583 May 13 21:55:07.891738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.892114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:07.892610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 222/450] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:07 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:07.892896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:07.893328 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:08.024024 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:08.031728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ed591774-ab7f-4448-b567-6d748537a3c4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.152460 May 13 21:55:08.032369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 229/451] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:07 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:08.172634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:08.173239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:08.179898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:08.180695 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:08.181473 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:08.181910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:08.312574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:08.320902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:08.322402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:08.323587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a58e6fc8-8c35-4034-bb03-997827832969 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.155473 May 13 21:55:08.324151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 223/452] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:08 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:08.909189 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:08.909921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:08.916669 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:08.917119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:08.917897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:08.918331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:09.049005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:09.049618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:09.049785 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:09.056324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:09.056864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:09.057261 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b560683a-efd2-43e7-957b-251312ad8ed9 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1315 microversion: 2.1 time: 0.151893 May 13 21:55:09.057776 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:09.058033 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 230/453] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:08 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:09.058345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:09.189741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:09.197450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fd05f406-0306-4f12-8b59-22b4668858da tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.152936 May 13 21:55:09.198108 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 224/454] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:09 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:09.341942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:09.342736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:09.348832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:09.349279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:09.350047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:09.350480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:09.480310 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:09.490391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:09.492310 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:09.493566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-82c7b627-35cf-4d06-b8bb-7d91c49a380a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.156184 May 13 21:55:09.494214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 231/455] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:09 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:10.074527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:10.075157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:10.081485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.081927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.082677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.083128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.212501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.213787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:10.214465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:10.220144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9611219b-258b-467a-9815-e2312578308c tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1465 microversion: 2.1 time: 0.149311 May 13 21:55:10.220718 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 225/456] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:10 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1465 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:10.220834 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.221268 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.222041 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.222482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.261313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:10.261805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:10.268336 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.268782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.269543 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.269976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.293978 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:55:10.364899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.373571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-fadd46c6-8423-4f21-abef-79057d421f11 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.163584 May 13 21:55:10.374146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 232/457] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:10 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:10.394822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f0ffa02e-0e21-40f4-93b4-d8937f66e398 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "DELETE /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 204 len: 0 microversion: 2.1 time: 0.136879 May 13 21:55:10.395507 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 226/458] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:55:10 2022] DELETE /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 21:55:10.412964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:10.413588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:10.420044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.420428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.421482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.422107 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.516363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:10.517463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:10.525630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.526481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.527380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:10.528196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:10.588293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.596173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-01af983e-8754-492d-b802-1256ca9b3a2f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1471 microversion: 2.1 time: 0.196318 May 13 21:55:10.606185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 233/459] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:10 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:10.673850 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.688900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.690799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:10.692849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-33427905-c9af-4cd2-8fcb-80809cde6afe tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.180709 May 13 21:55:10.694054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 227/460] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:10 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:55:11.391228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:11.391750 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:11.397915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.398356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.399132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.399561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.614076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:11.614823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:11.620910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.621365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.622638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.623193 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.794054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:11.801470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-795a8404-a8f6-4ce5-8d7b-6d8aea4c007f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.414743 May 13 21:55:11.802159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 234/461] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:11 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:11.806659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:11.808014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:11.814073 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.814521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.815316 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:11.815752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:11.836634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:11.843838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-26b74595-d9d7-4332-9e56-09819d31f1ea tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1471 microversion: 2.1 time: 0.234023 May 13 21:55:11.844407 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 228/462] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:11 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:11.941582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:11.949606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:11.951254 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:11.952397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b6477a6a-1ecd-486c-8148-9ab5650e255c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.149333 May 13 21:55:11.952966 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 235/463] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:11 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:12.817419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:12.818051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:12.823779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:12.824222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:12.824979 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:12.825924 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:12.860542 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:12.861219 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:12.867756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:12.868206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:12.868971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:12.869407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:12.997941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:13.005242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a84b3fd6-f329-438c-9442-823099a720b3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.191484 May 13 21:55:13.005823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 229/464] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:12 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:13.010329 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:13.011249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:13.018326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:13.018805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:13.019579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:13.020019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:13.034912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:13.065460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-85107b2c-463e-4dd6-8034-fd8042e9ce29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1471 microversion: 2.1 time: 0.208555 May 13 21:55:13.075015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 236/465] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:12 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:13.075015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-265594cf-36cb-4db8-bc2a-4e2e23d12790 req-559a769c-7d9f-438c-a36c-a29d563964b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "name": "network-vif-plugged", "status": "completed", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:13.079345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-265594cf-36cb-4db8-bc2a-4e2e23d12790 req-559a769c-7d9f-438c-a36c-a29d563964b0 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:13.079859 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-265594cf-36cb-4db8-bc2a-4e2e23d12790 req-559a769c-7d9f-438c-a36c-a29d563964b0 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:13.091032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-265594cf-36cb-4db8-bc2a-4e2e23d12790 req-559a769c-7d9f-438c-a36c-a29d563964b0 service nova] Creating event network-vif-plugged:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:55:13.096585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-265594cf-36cb-4db8-bc2a-4e2e23d12790 req-559a769c-7d9f-438c-a36c-a29d563964b0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029382 May 13 21:55:13.097346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 237/466] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:13.156133 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:13.164407 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:13.165915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:13.167087 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7920643b-e19a-43e9-af84-ee5c59dc8355 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.160325 May 13 21:55:13.167642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 230/467] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:13 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:14.022247 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:14.023038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:14.028952 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.029393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.030149 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.030576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.082582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:14.083909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:14.089810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.090261 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.091271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.091940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.201001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:14.208404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-83bd9060-13f7-48d7-9597-029c8f10c703 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.190767 May 13 21:55:14.208979 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 238/468] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:14 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:14.213346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:14.213946 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:14.219617 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.220062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.220821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:14.221254 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:14.244464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:14.252416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d824db13-69d1-4c39-bfb2-4edf300ce637 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1471 microversion: 2.1 time: 0.173749 May 13 21:55:14.252975 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 231/469] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:14 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:14.353123 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:14.361735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:14.363524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:14.364664 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bc80096c-c462-4aa2-ac4b-94dcf830ef35 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.154777 May 13 21:55:14.365252 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 239/470] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:14 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:15.214783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-8ee9bb74-17b7-4039-a60d-03f4aa9e1af0 req-0171ad3b-dbd1-42f8-ac67-4a26972a2ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088c5aa6-3b49-4691-bdf5-b95a4d1a8456", "name": "network-vif-deleted", "tag": "2ee29915-e8f4-4613-8c77-02fb7349c44e"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:15.224304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8ee9bb74-17b7-4039-a60d-03f4aa9e1af0 req-0171ad3b-dbd1-42f8-ac67-4a26972a2ef1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.224980 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8ee9bb74-17b7-4039-a60d-03f4aa9e1af0 req-0171ad3b-dbd1-42f8-ac67-4a26972a2ef1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.225643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:15.226522 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:15.233366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.234634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.234914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.235504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.244836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-8ee9bb74-17b7-4039-a60d-03f4aa9e1af0 req-0171ad3b-dbd1-42f8-ac67-4a26972a2ef1 service nova] Creating event network-vif-deleted:2ee29915-e8f4-4613-8c77-02fb7349c44e for instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 on hv-cinder-84051 May 13 21:55:15.250079 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-8ee9bb74-17b7-4039-a60d-03f4aa9e1af0 req-0171ad3b-dbd1-42f8-ac67-4a26972a2ef1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038945 May 13 21:55:15.250759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 232/471] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:15.270069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:15.270963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:15.277352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.278044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.279605 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.280117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.369487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:15.377388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6858c0ff-6c7a-4ccc-815f-f2ed54ccfdc5 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1429 microversion: 2.1 time: 0.111569 May 13 21:55:15.378263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 233/472] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:15 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:15.383232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:15.383859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:15.390755 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.391240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.392608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:15.393159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:15.419778 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:15.427507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e1b09167-f6d7-4dab-ab55-51622336953e tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.206151 May 13 21:55:15.428169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 240/473] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:15 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:15.522176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:15.530539 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:15.532247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:15.533397 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-36c60cc1-2383-4cc6-a99d-79d3f41d8b88 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.153837 May 13 21:55:15.533957 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 234/474] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:15 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:16.045774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-2e017b20-4203-4930-93d3-bd1b168530f2 req-e1e21f8b-0275-4adb-8073-587cc14b49fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "name": "network-vif-plugged", "status": "completed", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:16.049414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-2e017b20-4203-4930-93d3-bd1b168530f2 req-e1e21f8b-0275-4adb-8073-587cc14b49fd service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.050179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-2e017b20-4203-4930-93d3-bd1b168530f2 req-e1e21f8b-0275-4adb-8073-587cc14b49fd service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.068532 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-2e017b20-4203-4930-93d3-bd1b168530f2 req-e1e21f8b-0275-4adb-8073-587cc14b49fd service nova] Creating event network-vif-plugged:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:55:16.073554 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-2e017b20-4203-4930-93d3-bd1b168530f2 req-e1e21f8b-0275-4adb-8073-587cc14b49fd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 May 13 21:55:16.074634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 241/475] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:16.393084 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:16.393809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:16.399932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.400105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.400803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.401223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.432216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.432663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.433119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lazy-loading 'fault' on Instance uuid 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:55:16.445136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:16.445827 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:16.461027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.461795 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.462790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.463407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.504504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75a06208154149a88ca10d30520a58d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a480dd328dbc461690b7a80095a21967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:16.512315 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f57f2fd0-69cd-4f6d-86cb-268ae091549f tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 200 len: 1305 microversion: 2.1 time: 0.122943 May 13 21:55:16.513429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 235/476] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:16 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:16.551705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:16.552309 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:16.558114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.558823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.559680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:16.560279 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:16.645429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:16.654192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6747922f-0511-4bef-8051-57404f525a2a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.212412 May 13 21:55:16.655875 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 242/477] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:16 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:16.713230 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:16.722798 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:16.724292 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:16.725555 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9aad9d9a-5282-498c-8cce-9db821d8ec5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1806 microversion: 2.20 time: 0.177702 May 13 21:55:16.726138 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 236/478] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:16 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:17.529582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:17.530351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] [instance: 088c5aa6-3b49-4691-bdf5-b95a4d1a8456] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:17.537606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.538132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.538941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.539496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.553388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] HTTP exception thrown: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Request method failure captured: May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 HTTP/1.1 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftOKTC7UCV4D-3EQiElbBGfN8QfyphwmUsvOKpuzo1mPFy111f_z7A_AI1KpLGk5j_1-beAAPfsssX1fvMywh0E-i4quxE5pY_EmttQyzYnrW2iRC2SFO9Z_TujU0brk-17c6YNxt8s4yJ9i4nGcaV1Gowv9lCnDk84BRSvs2reC6Jw May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a480dd328dbc461690b7a80095a21967 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesNegativeTest-211480283 May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:55:17.555060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a480dd328dbc461690b7a80095a21967"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a480dd328dbc461690b7a80095a21967"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a480dd328dbc461690b7a80095a21967"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a480dd328dbc461690b7a80095a21967"}]}] May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesNegativeTest-211480283 May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a480dd328dbc461690b7a80095a21967 May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesNegativeTest-211480283 May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesNegativeTest-211480283-project May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 75a06208154149a88ca10d30520a58d5 May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesNegativeTest-211480283-project May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. May 13 21:55:17.556540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '088c5aa6-3b49-4691-bdf5-b95a4d1a8456'} May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:55:17.557548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. May 13 21:55:17.559049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:55:17.560914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] Returning 404 to user: Instance 088c5aa6-3b49-4691-bdf5-b95a4d1a8456 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:55:17.560914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e75b0d78-9d2d-40a3-8a76-175a7bfb9f29 tempest-VolumesNegativeTest-211480283 tempest-VolumesNegativeTest-211480283-project] 10.222.0.35 "GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456" status: 404 len: 111 microversion: 2.1 time: 0.030990 May 13 21:55:17.560914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 243/479] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:17 2022] GET /compute/v2.1/servers/088c5aa6-3b49-4691-bdf5-b95a4d1a8456 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:55:17.671953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:17.672736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:17.679323 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.680058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.680839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.681278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.746104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:17.747031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:17.753035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.753590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.754563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:17.755124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:17.846806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:17.854175 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-65edffcb-3a5e-4f6d-b4aa-6a05523c7498 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.186857 May 13 21:55:17.854761 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 237/480] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:17 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:17.917036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:17.925659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:17.927175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:17.928313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8572dd39-9c0f-4710-a91e-7c81a3b40042 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1793 microversion: 2.20 time: 0.186110 May 13 21:55:17.928871 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 244/481] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:55:17 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1793 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:55:18.871558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:18.872272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:18.878051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:18.878499 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:18.879286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:18.879725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:19.008299 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:19.016808 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3c141197-ac44-40f5-a7a6-ca1f266c1675 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.149045 May 13 21:55:19.017447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 238/482] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:18 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:20.034103 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:20.034738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:20.040983 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:20.041434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:20.042191 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:20.042628 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:20.166821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:20.174463 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f7af8b75-6340-4b9a-bced-878f4970a8a1 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1359 microversion: 2.1 time: 0.144135 May 13 21:55:20.175049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 245/483] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:20 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:21.191641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:21.192312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:21.198215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.198663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.199463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.199902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.338784 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:21.346885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ddf737c6-e4cd-4b78-88f9-b1236905a70f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1549 microversion: 2.1 time: 0.159141 May 13 21:55:21.347457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 239/484] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:21 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:21.363961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:21.364573 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:21.370797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.371252 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.372044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.372486 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.498557 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:21.505802 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c0eb2f91-1ad9-47b5-b1f3-acbfbdf5a8fe tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1549 microversion: 2.1 time: 0.145814 May 13 21:55:21.506365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 246/485] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:21 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:21.520996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:21.524463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:21.525332 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Searching by: {'deleted': False, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f'} {{(pid=128489) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 21:55:21.532611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.532997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.533791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.534224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.627097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.multi_cell_list [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128489) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 21:55:21.722311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7822d6ef-caff-4931-a5cb-bfb7b81761d4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204961 May 13 21:55:21.722922 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 240/486] 10.222.0.35 () {58 vars in 1124 bytes} [Fri May 13 21:55:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:21.733245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:21.733860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:21.739948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.740401 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.741168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:21.741608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:21.870434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:21.877884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-03d338a3-4342-4846-b57e-54628f3e2c21 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1549 microversion: 2.1 time: 0.148546 May 13 21:55:21.878460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 247/487] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:21 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:23.389491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a3182d8-e1dd-4994-b8ec-72b91abce6a2"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:23.390192 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:23.396038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:23.396488 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:23.397249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:23.397686 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:23.665740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0d60142b-300e-443c-a1bb-204c5e378283 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280821 May 13 21:55:23.666544 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 241/488] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:55:23 2022] POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:25.396040 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa08a00-1749-4aa9-903a-fca0a3d6fbbc"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:25.397208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:25.403517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:25.403965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:25.404721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:25.405157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:25.658324 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8638f089-6557-4d24-a88a-5f28a9422060 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266059 May 13 21:55:25.659190 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 248/489] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:55:25 2022] POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:31.216531 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:31.217582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:31.226590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:31.227069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:31.227837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:31.228276 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:31.374429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:31.386628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6843940e-a12b-444e-936d-1fc221b9a9de tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1595 microversion: 2.1 time: 0.175689 May 13 21:55:31.387291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 242/490] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:31 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1595 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:33.186014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-f5cc2a76-47a1-4eca-8e81-e424b60d6be7 req-03c82c7c-04ba-40c1-a971-8d7838b32068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:33.202879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f5cc2a76-47a1-4eca-8e81-e424b60d6be7 req-03c82c7c-04ba-40c1-a971-8d7838b32068 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:33.203419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f5cc2a76-47a1-4eca-8e81-e424b60d6be7 req-03c82c7c-04ba-40c1-a971-8d7838b32068 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:33.216274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-f5cc2a76-47a1-4eca-8e81-e424b60d6be7 req-03c82c7c-04ba-40c1-a971-8d7838b32068 service nova] Creating event network-changed:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:55:33.221329 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-f5cc2a76-47a1-4eca-8e81-e424b60d6be7 req-03c82c7c-04ba-40c1-a971-8d7838b32068 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039795 May 13 21:55:33.222301 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 249/491] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:34.282902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-83901056"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:34.283486 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:34.289901 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:34.290307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:34.291110 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:34.291553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:34.421908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.network.security_group_api [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Adding security group 127fdbe8-6f69-4e2d-b327-1b5b465a5353 to port 4c96b3ab-f491-41d1-841b-d63a58be11a5 May 13 21:55:34.799905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-19f6b3d0-4c21-4c8d-adbd-d918d49bab2d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action" status: 202 len: 0 microversion: 2.1 time: 0.521406 May 13 21:55:34.801716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 243/492] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:55:34 2022] POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:55:34.811004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-d70e9dde-1b8f-4a1f-aced-c0ec9234a51a req-dc88c147-d80e-4b65-83b1-6118cc4ba357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:34.811603 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:34.812309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:34.820169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:34.820621 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:34.821397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:34.821744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d70e9dde-1b8f-4a1f-aced-c0ec9234a51a req-dc88c147-d80e-4b65-83b1-6118cc4ba357 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:34.821866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:34.822311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d70e9dde-1b8f-4a1f-aced-c0ec9234a51a req-dc88c147-d80e-4b65-83b1-6118cc4ba357 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:34.836918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-d70e9dde-1b8f-4a1f-aced-c0ec9234a51a req-dc88c147-d80e-4b65-83b1-6118cc4ba357 service nova] Creating event network-changed:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:55:34.842774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-d70e9dde-1b8f-4a1f-aced-c0ec9234a51a req-dc88c147-d80e-4b65-83b1-6118cc4ba357 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 May 13 21:55:34.843708 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 244/493] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:55:34.973645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:34.981260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bdc98c02-6fb6-41f2-98da-22765ebf9bd7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1759 microversion: 2.1 time: 0.174952 May 13 21:55:34.982340 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 250/494] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:34 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:43.648691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:55:43.649722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:43.656855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:43.657308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:43.658082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:43.658523 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:43.681759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lazy-loading 'flavor' on Instance uuid 3f33aec3-61e0-4d19-a71b-4335e1a37c28 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:55:43.799126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a2d96aed-6111-461d-af9d-3736a05fc5ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/action" status: 200 len: 32 microversion: 2.1 time: 0.154521 May 13 21:55:43.799653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 245/495] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:55:43 2022] POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 21:55:43.808706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:43.809424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:43.815804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:43.816257 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:43.817039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:43.817471 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:43.964048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:43.972749 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-31ab4593-a5bc-4b28-adf3-d62715d5f8e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.167848 May 13 21:55:43.973331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 251/496] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:43 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:44.990335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:44.991051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:44.996946 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:44.997397 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:44.998175 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:44.998614 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:45.132413 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:45.140319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8e392cdb-334c-4d44-87ae-1de41eb83ef7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.154798 May 13 21:55:45.140886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 246/497] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:44 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:46.158057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:46.158667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:46.165043 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:46.165496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:46.166261 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:46.166717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:46.293703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:46.301396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-377e7611-1693-475a-aee3-53617e6cb9e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.147164 May 13 21:55:46.301963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 252/498] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:46 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:47.318228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:47.319448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:47.328931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:47.329396 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:47.330395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:47.330644 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:47.459182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:47.466954 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-feeae0bb-d77a-4aff-ac7b-87547247bc57 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.152669 May 13 21:55:47.467518 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 247/499] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:47 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:48.483459 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:48.484069 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:48.490637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:48.491112 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:48.491868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:48.492309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:48.622753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:48.630453 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-72b28975-d58c-4b2b-bdda-fc4254e514e6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.150887 May 13 21:55:48.631057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 253/500] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:48 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:49.647678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:49.648271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:49.655627 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:49.656082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:49.656852 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:49.657294 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:49.782979 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:49.790781 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-25fa331a-03ba-47b4-8344-230010515753 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.146917 May 13 21:55:49.791344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 248/501] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:49 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:50.807778 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:50.808324 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:50.815255 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:50.815702 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:50.816460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:50.816894 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:50.948988 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:50.956552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8a1cbc24-0f17-4794-a79a-03df24086281 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.152690 May 13 21:55:50.957108 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 254/502] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:50 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:55:51.973263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:51.973921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:51.980198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:51.980650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:51.982057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:51.982498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:52.116971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:52.125323 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2f9733ba-135c-4bc0-9147-037d4461428a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.155796 May 13 21:55:52.125888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 249/503] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:51 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:53.142217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:53.142851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:53.149101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:53.149570 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:53.150322 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:53.150781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:53.282182 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:53.290495 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f6e0ce82-d19a-4570-b82e-64f589573526 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.152043 May 13 21:55:53.291078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 255/504] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:53 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:54.307546 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:54.308152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:54.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:54.315058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:54.315823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:54.316255 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:54.441743 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:54.449429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-533489e7-525d-459a-a417-4616020edb61 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.145885 May 13 21:55:54.450001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 250/505] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:54 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:55.466447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:55.467076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:55.473643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:55.474089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:55.474886 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:55.475314 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:55.599511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:55.607163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1e349ee6-2d52-4126-b7dd-c4fbf7f1a2f9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.144583 May 13 21:55:55.607737 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 256/506] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:55 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:56.624839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:56.625441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:56.631759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:56.632212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:56.632980 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:56.633414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:56.761355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:56.768994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d02a1acc-2c25-4efc-a461-8c055417696d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.148536 May 13 21:55:56.769554 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 251/507] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:56 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:57.784975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:57.785583 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:57.792064 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:57.792601 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:57.793361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:57.793796 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:57.918305 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:57.925950 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c3cf9569-2e11-4c35-9f59-c17f3776f88b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.144808 May 13 21:55:57.926508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 257/508] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:57 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:58.943947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:58.944653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:58.952235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:58.954135 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:58.955942 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:58.956390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:59.082772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:55:59.090406 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-05ef43c6-b322-40c6-94fc-fc91f0dc757b tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.150265 May 13 21:55:59.090998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 252/509] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:55:58 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:55:59.902114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:55:59.903288 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:55:59.909578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:59.910029 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:59.910826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:55:59.911260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:55:59.940674 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f5b9efd4-ac26-4874-976a-8ce7debdff37 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments/0eac51ae-bc06-4ae3-b81f-134bdc89bf31" status: 200 len: 194 microversion: 2.20 time: 0.042684 May 13 21:55:59.941242 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 258/510] 10.222.0.35 () {60 vars in 1453 bytes} [Fri May 13 21:55:59 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments/0eac51ae-bc06-4ae3-b81f-134bdc89bf31 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:56:00.000308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:00.000819 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:00.007059 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.007507 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.008260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.008693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.107216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:00.107829 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:00.114140 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.114592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.115402 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.115840 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.136496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lazy-loading 'services' on Instance uuid c1cdc615-a1e5-435d-95d3-f1187a00f7e0 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:56:00.243213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:00.250132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a49f90cc-1df9-4f4e-80c3-885c65487e84 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments/0eac51ae-bc06-4ae3-b81f-134bdc89bf31" status: 202 len: 0 microversion: 2.20 time: 0.254231 May 13 21:56:00.250948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 253/511] 10.222.0.35 () {60 vars in 1456 bytes} [Fri May 13 21:55:59 2022] DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments/0eac51ae-bc06-4ae3-b81f-134bdc89bf31 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 21:56:00.252023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-26f9ee82-5602-453b-bcbc-3cfb922f2d6c tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.148619 May 13 21:56:00.252586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 259/512] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:00 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:00.259737 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:00.260963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:00.268014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.268487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.269466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:00.269910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:00.298930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5ac67901-1c0e-4627-bc5e-85b96c7b4bab tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043461 May 13 21:56:00.299496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 254/513] 10.222.0.35 () {60 vars in 1342 bytes} [Fri May 13 21:56:00 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:56:01.268234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:01.268844 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:01.275091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.275643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.276407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.276844 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.310221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:01.311187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:01.317589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.318038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.318841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.319273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.348180 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3b0ed6f0-cd24-4356-98a7-8ccf88037538 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041827 May 13 21:56:01.348740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 255/514] 10.222.0.35 () {60 vars in 1342 bytes} [Fri May 13 21:56:01 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:01.403670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:01.406062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:01.406569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:01.411799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e1f813df-0fe8-438e-a743-d6242e646409 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.147305 May 13 21:56:01.412295 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 260/515] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:01 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:01.412401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.412814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.413581 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.414027 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.437941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:56:01.513242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-561b532a-eab8-485f-99d6-d1dd18170fbc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 204 len: 0 microversion: 2.20 time: 0.111135 May 13 21:56:01.513821 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 256/516] 10.222.0.35 () {60 vars in 1279 bytes} [Fri May 13 21:56:01 2022] DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 13 21:56:01.522547 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:01.523198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:01.528995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.529524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.530283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:01.530728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:01.658168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:01.665835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:01.667286 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:01.668439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c921ca68-cc83-4733-8634-9cf4c5c29bbd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.149880 May 13 21:56:01.669016 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 261/517] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:01 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:02.429346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:02.429955 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:02.436251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:02.436703 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:02.437466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:02.437904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:02.561485 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:02.569211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-86c15b82-a637-4594-9454-fc49b9b1b82e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.144148 May 13 21:56:02.569776 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 257/518] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:02 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:02.687334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:02.688091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:02.694443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:02.694921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:02.695671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:02.696100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:02.824534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:02.832226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:02.833721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:02.834903 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9a8442cb-757e-4379-83bf-3057a00eb568 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.152096 May 13 21:56:02.835467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 262/519] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:02 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:03.586411 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:03.587026 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:03.593927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:03.594377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:03.595178 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:03.595617 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:03.729153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:03.738282 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1f5307a6-3dae-44e4-b6d3-2893e5fbf77a tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.155708 May 13 21:56:03.739345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 258/520] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:03 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:03.852911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:03.854228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:03.860702 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:03.862010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:03.862981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:03.863418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:04.004432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:04.013310 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:04.014847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:04.016008 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-180a831e-2d26-4d67-8cae-330536a1958c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1721 microversion: 2.20 time: 0.166950 May 13 21:56:04.016573 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 263/521] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:03 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:04.385610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-40bb51cd-c49c-4a66-9f92-6a1dffec0e21 req-ce84d089-2af7-4d35-8a8e-85a9211f87b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cdc615-a1e5-435d-95d3-f1187a00f7e0", "name": "network-vif-deleted", "tag": "880b4122-8d33-43a8-a0b1-a0f01711790c"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:04.395750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-40bb51cd-c49c-4a66-9f92-6a1dffec0e21 req-ce84d089-2af7-4d35-8a8e-85a9211f87b8 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:04.396533 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-40bb51cd-c49c-4a66-9f92-6a1dffec0e21 req-ce84d089-2af7-4d35-8a8e-85a9211f87b8 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:04.408119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-40bb51cd-c49c-4a66-9f92-6a1dffec0e21 req-ce84d089-2af7-4d35-8a8e-85a9211f87b8 service nova] Creating event network-vif-deleted:880b4122-8d33-43a8-a0b1-a0f01711790c for instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 on hv-cinder-84051 May 13 21:56:04.413272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-40bb51cd-c49c-4a66-9f92-6a1dffec0e21 req-ce84d089-2af7-4d35-8a8e-85a9211f87b8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 May 13 21:56:04.414257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 259/522] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:04.755933 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:04.756655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:04.763057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:04.763586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:04.764513 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:04.765028 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:04.903327 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:04.912406 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-adde28e9-0eb2-4bce-aa1d-8a165edbf607 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.160285 May 13 21:56:04.913282 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 264/523] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:04 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:05.039963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:05.042134 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:05.053194 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:05.053979 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:05.055682 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:05.056438 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:05.092119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:05.092578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:05.093035 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lazy-loading 'fault' on Instance uuid c1cdc615-a1e5-435d-95d3-f1187a00f7e0 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:56:05.142390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:05.150288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:05.152810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:05.154311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bae89936-f01c-413f-9260-9e00ee435648 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 200 len: 1371 microversion: 2.20 time: 0.123484 May 13 21:56:05.155358 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 260/524] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:05 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:05.929709 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:05.930250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:05.937171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:05.937619 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:05.938382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:05.938850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:06.067544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:06.075264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a1916b84-34e8-46f2-851a-3ccc5cdb0ab9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.149531 May 13 21:56:06.075832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 265/525] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:05 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:06.173833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:06.174438 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:06.180719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:06.181108 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:06.181860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:06.182290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:06.196994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 HTTP/1.1 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:56:06.198612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:56:06.200354 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c1cdc615-a1e5-435d-95d3-f1187a00f7e0'} May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:56:06.201216 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:56:06.202789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:06.204009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:56:06.204009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-39fc4b7f-a2c4-4be3-bac2-ab77a2d3159e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 404 len: 111 microversion: 2.20 time: 0.029971 May 13 21:56:06.204009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 261/526] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:06 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:56:06.208723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-98675faf-82bb-4b81-9877-c2969bbf877a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '.version_select at 0x7fb7d664ee50>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:06.228923 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-98675faf-82bb-4b81-9877-c2969bbf877a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078324895" status: 204 len: 0 microversion: 2.20 time: 0.023926 May 13 21:56:06.229482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 266/527] 10.222.0.35 () {60 vars in 1261 bytes} [Fri May 13 21:56:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078324895 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 13 21:56:06.885423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e8f9688-fa3f-4a5a-83da-442c6504e5e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: .version_select at 0x7fb7d6cd0af0>, body: {"keypair": {"name": "tempest-keypair-1415147735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3CDOnldvvGuPp6yBsh77rrl4wAV5G4cNiImUARuaH086cXsrbUdL6hJ67Okx78GUGkmcvkc+xEyV+onov6YrDntaqird2pLd+B3Zwv9p2Ph41WjRp80yYZUgRDcmeUHA=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:06.899697 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-8e8f9688-fa3f-4a5a-83da-442c6504e5e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:56:06.903396 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-8e8f9688-fa3f-4a5a-83da-442c6504e5e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for user 0a1425d092844a2e9b8a917dc9981b32 and project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:56:06.924839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8e8f9688-fa3f-4a5a-83da-442c6504e5e2 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043546 May 13 21:56:06.925417 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 262/528] 10.222.0.35 () {62 vars in 1199 bytes} [Fri May 13 21:56:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 21:56:07.093525 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:07.094229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:07.101463 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.102183 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.103082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.103597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.237355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:07.238387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:07.246287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.247775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.249298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.250184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.290295 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:07.300456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-32f1d07b-3d71-4f44-abd5-6c8145199c3f tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.211606 May 13 21:56:07.301712 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 267/529] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:07 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:07.340999 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ee73b4fa-64b1-4906-9721-4b8385e32256 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action" status: 202 len: 0 microversion: 2.1 time: 0.107815 May 13 21:56:07.342158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 263/530] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:56:07 2022] POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 21:56:07.350853 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:07.352169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:07.359258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.359827 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.360981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:07.362111 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:07.592789 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:07.604518 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0c82499e-bd37-4850-b392-90c29a10138f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1751 microversion: 2.1 time: 0.257374 May 13 21:56:07.605915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 268/531] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:07 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:08.320554 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:08.321351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:08.328068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:08.328520 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:08.329286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:08.329720 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:08.446094 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1183683407", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54bb408e-38dc-4d63-b590-fa8bf9ca4da7"}], "security_groups": [{"name": "tempest-securitygroup--1807627684"}], "key_name": "tempest-keypair-1415147735", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:08.465859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:08.473492 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0b635278-9c91-466d-ac6c-2b2ad70ca25d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.157624 May 13 21:56:08.474131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 264/532] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:08 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:08.549153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] validate_networks() for [('54bb408e-38dc-4d63-b590-fa8bf9ca4da7', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:56:08.622964 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:08.623570 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:08.629592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:08.629983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:08.630763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:08.631205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:08.845339 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:08.853014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e0f79b71-dba9-4f30-8c44-b5333e371fe5 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.234454 May 13 21:56:08.853584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 265/533] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:08 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:08.992627 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:56:08.993048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:56:08.993523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:56:08.993930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:56:08.994353 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:56:09.002855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.003302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:09.004101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.004536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:09.020377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:56:09.024215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Getting quotas for user 0a1425d092844a2e9b8a917dc9981b32 and project 6a12e6fa2119499b93806f036eb55a0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:56:09.035435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:56:09.037689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:56:09.084850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3e18eecf-5aa0-478e-95b5-1c98b3902f4c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.643052 May 13 21:56:09.085502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 269/534] 10.222.0.35 () {62 vars in 1187 bytes} [Fri May 13 21:56:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 13 21:56:09.096053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:09.096653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:09.150038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:09.158060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:09.159587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:09.160673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6c169b7c-923a-44af-83ba-93f28c865572 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1282 microversion: 2.20 time: 0.068552 May 13 21:56:09.161312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 266/535] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:09 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:09.491308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:09.491907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:09.498695 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.499173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:09.499948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.500365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:09.630477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:09.638925 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-887bc645-beca-48ee-9fd9-710fd39507ad tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.152289 May 13 21:56:09.639508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 270/536] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:09 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:09.871039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:09.872188 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:09.879333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.879778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:09.880534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:09.880968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:10.018310 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:10.026137 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f3eb2283-475e-44d2-9aee-db2beccd6de4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.159001 May 13 21:56:10.026712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 267/537] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:09 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:10.178588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:10.179633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:10.186727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:10.187907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:10.188781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:10.189480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:10.254521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:10.263103 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:10.264500 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:10.265788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-48d9bf24-bccb-48cc-8074-fae922980014 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1352 microversion: 2.20 time: 0.090985 May 13 21:56:10.268488 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 271/538] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:10 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:10.656733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:10.657655 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:10.663487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:10.663930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:10.664719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:10.665149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.038657 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:11.042606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:11.043254 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:11.047678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4f2c74af-cade-4d20-a6ae-195cd9565068 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.395644 May 13 21:56:11.048508 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 268/539] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:10 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:11.052658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:11.053302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.054058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:11.054648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.199630 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:11.207361 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a6548972-e7aa-463d-bef8-51776bacd48b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.168447 May 13 21:56:11.207933 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 272/540] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:11 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:11.284630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:11.285159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:11.291011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:11.291467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.292236 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:11.292674 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.444790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:11.453239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:11.455577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:11.456960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1fee7fd5-c163-4bd6-a803-9b051cf5409c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.176235 May 13 21:56:11.457526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 269/541] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:11 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:11.601799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-5b2227a0-8334-4589-b62a-d4be98ffeba1 req-6f242057-8fd8-40c4-95d5-5b0b601b0cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:11.610371 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5b2227a0-8334-4589-b62a-d4be98ffeba1 req-6f242057-8fd8-40c4-95d5-5b0b601b0cb3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:11.610861 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5b2227a0-8334-4589-b62a-d4be98ffeba1 req-6f242057-8fd8-40c4-95d5-5b0b601b0cb3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:11.632456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-5b2227a0-8334-4589-b62a-d4be98ffeba1 req-6f242057-8fd8-40c4-95d5-5b0b601b0cb3 service nova] Creating event network-changed:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:56:11.638242 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-5b2227a0-8334-4589-b62a-d4be98ffeba1 req-6f242057-8fd8-40c4-95d5-5b0b601b0cb3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044887 May 13 21:56:11.638873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 273/542] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:12.065738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:12.066322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:12.072811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.073268 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.074076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.074513 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.205367 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:12.213085 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-39ce0cb4-07c6-40e7-937c-8f5a267ed1d3 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.151322 May 13 21:56:12.213641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 270/543] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:12 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:12.226078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:12.226909 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:12.233076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.233590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.234448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.235032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.378219 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:12.386629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-09a08c78-9926-4700-ba57-8ea51ff79705 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.165135 May 13 21:56:12.387232 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 274/544] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:12 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:12.475582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:12.476219 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:12.482571 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.483050 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.483823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:12.484263 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:12.607098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:12.614999 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:12.616497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:12.617584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d84fcdf1-d0f4-45b9-b99e-639ea8e4d458 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.145857 May 13 21:56:12.618143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 271/545] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:12 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:13.229787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:13.230393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:13.236940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.237389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.238139 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.238569 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.362332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:13.369948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-58167470-09e8-405d-86e7-e4f1ef32261e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.143983 May 13 21:56:13.370505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 275/546] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:13 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:13.403782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:13.404388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:13.410403 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.410820 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.411588 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.412031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.560794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:13.568613 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-63a100cc-517a-4af6-aee0-af99f5b1cea3 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.169108 May 13 21:56:13.569176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 272/547] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:13 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:13.636118 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:13.636723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:13.643603 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.644055 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.644861 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:13.645299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:13.774675 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:13.782515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:13.784086 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:13.785319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d782b378-cbfd-45a4-ad67-1580a3158857 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.153369 May 13 21:56:13.785880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 276/548] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:13 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:56:14.386078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:14.386688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:14.392763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.393212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.393973 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.394405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.522900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:14.530986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-353e10f3-07d6-465b-98a7-79e808356fd4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.148777 May 13 21:56:14.531544 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 273/549] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:14 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:14.585099 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:14.585721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:14.592622 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.593058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.593804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.594232 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.730553 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:14.738524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b74cfcf8-d2af-4ef9-b801-d2148d8c72b6 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.157220 May 13 21:56:14.739128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 277/550] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:14 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:14.803860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:14.804466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:14.810632 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.811124 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.811894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:14.812334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:14.942373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:14.951465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:14.952949 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:14.954055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-267b35b9-ab86-46ea-9609-c38180a9dffb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.154024 May 13 21:56:14.954598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 274/551] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:14 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:15.547534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:15.548127 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:15.553867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.554322 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:15.555132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.555572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:15.681658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:15.690076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-035bb45c-1808-4630-aa65-09eb2f5cd6f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.146881 May 13 21:56:15.690638 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 278/552] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:15 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:15.755197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:15.755802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:15.762000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.762451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:15.763256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.763729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:15.913478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:15.922097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-515a4dda-89ea-4b1c-b17a-af9ce5a561bc tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.170697 May 13 21:56:15.922681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 275/553] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:15 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:15.972694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:15.973337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:15.979282 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.979724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:15.980481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:15.981489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:16.113430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:16.121368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:16.123487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:16.124586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-962c33f7-630e-4497-8d20-512e933287f6 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.155756 May 13 21:56:16.125151 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 279/554] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:15 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:16.707538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:16.708143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:16.714056 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:16.714537 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:16.715326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:16.716287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:16.840129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:16.848468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d39b9ac0-e46c-42e1-bb2a-be3ee7cf3ac7 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1733 microversion: 2.1 time: 0.144696 May 13 21:56:16.849023 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 276/555] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:16 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:16.939057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:16.939667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:16.946014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:16.946465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:16.947267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:16.947707 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:17.094420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:17.102205 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-44c5b22b-6314-440f-a784-aaeec35157ff tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.167072 May 13 21:56:17.102793 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 280/556] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:16 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:17.141928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:17.142529 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:17.148257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:17.148709 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:17.149497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:17.149934 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:17.176322 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-211b99d5-4af9-43a8-8bc3-ece6c29ef39f req-4db8468e-7f08-4c61-b26b-7822b22446ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "name": "network-vif-plugged", "status": "completed", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:17.186679 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-211b99d5-4af9-43a8-8bc3-ece6c29ef39f req-4db8468e-7f08-4c61-b26b-7822b22446ab service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:17.187566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-211b99d5-4af9-43a8-8bc3-ece6c29ef39f req-4db8468e-7f08-4c61-b26b-7822b22446ab service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:17.203740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-211b99d5-4af9-43a8-8bc3-ece6c29ef39f req-4db8468e-7f08-4c61-b26b-7822b22446ab service nova] Creating event network-vif-plugged:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:56:17.208774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-211b99d5-4af9-43a8-8bc3-ece6c29ef39f req-4db8468e-7f08-4c61-b26b-7822b22446ab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 May 13 21:56:17.209473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 281/557] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:56:17.289143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:17.304277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:17.305762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:17.306935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3eaf3ab4-8da8-4392-8148-9e95bcf7be27 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.169379 May 13 21:56:17.307442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 277/558] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:17 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:17.865913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:17.866618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:17.873278 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:17.873727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:17.874492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:17.874967 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.003229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.010938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-00b1641c-722c-48f5-8d57-f7a4cd9d3b48 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1713 microversion: 2.1 time: 0.149364 May 13 21:56:18.011443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 282/559] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:17 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:18.114214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:18.114798 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:18.119258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:18.119917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:18.121507 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.121963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.122757 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.123196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.126152 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.126683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.127576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.128074 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.202300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] HTTP exception thrown: Cannot 'detach_volume' instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 while it is in vm_state rescued May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Request method failure captured: May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments/1fa08a00-1749-4aa9-903a-fca0a3d6fbbc HTTP/1.1 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL6obtLfoMakldR6LzjoEXadqit41RP1TrdbbcjtNpiAXkZsqTgRzLC2AEGm9VaL6QSK4iwx3ZJBYbrG3e3Vi-_1uGU_N7L8E0jn1VdsUyUqgMbdl_J22hiDw6XPuIENkCKnExuyTiyyxgYwlGR92lsbysvJuipuFRsdhtxEFupi1k May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:56:18.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_428d047f511945e5bdf35eb8ed236507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/428d047f511945e5bdf35eb8ed236507"}]}] May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 6b11a3de8b71482594a04ab7e53a94bd May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:56:18.205527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Cannot 'detach_volume' instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 while it is in vm_state rescued May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'server_id': '3f33aec3-61e0-4d19-a71b-4335e1a37c28', 'id': '1fa08a00-1749-4aa9-903a-fca0a3d6fbbc'} May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:56:18.206289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 while it is in vm_state rescued May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 while it is in vm_state rescued May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:18.207792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Returning 409 to user: Cannot 'detach_volume' instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 while it is in vm_state rescued {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:56:18.210011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0a8445db-c5a7-44aa-bc3f-9ce09b8efdf9 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments/1fa08a00-1749-4aa9-903a-fca0a3d6fbbc" status: 409 len: 152 microversion: 2.1 time: 0.095384 May 13 21:56:18.210011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 278/560] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 21:56:18 2022] DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments/1fa08a00-1749-4aa9-903a-fca0a3d6fbbc => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 21:56:18.213940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:18.214826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:18.222829 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.223624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.224840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.225287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.272330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.280771 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0e03c188-a23d-48cc-a653-51a68960c507 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.165255 May 13 21:56:18.281338 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 283/561] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:18 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:18.296239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-41127f0f-bd5e-49f0-9567-a433b3b0c0f5 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/action" status: 202 len: 0 microversion: 2.1 time: 0.085660 May 13 21:56:18.296855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 279/562] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:56:18 2022] POST /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 21:56:18.304724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:18.305329 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:18.311196 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.311645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.312401 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.312835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.325834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:18.326522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:18.332466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.332917 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.333683 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:18.334125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:18.498489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.506305 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9a2b05ef-78bb-440e-9989-cfcb596c036e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1721 microversion: 2.1 time: 0.205195 May 13 21:56:18.507119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 284/563] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:18 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:18.509928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.518296 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.519955 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:18.521699 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b784e3db-b1b9-424b-b198-6d14da7bde0d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1408 microversion: 2.20 time: 0.200129 May 13 21:56:18.522150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 280/564] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:18 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:56:19.298927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:19.299593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:19.305766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.306209 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.306989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.307420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.450136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:19.459784 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-29f76d2d-d8a4-409c-8612-515aff5771be tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.164583 May 13 21:56:19.460676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 285/565] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:19 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:19.523733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:19.525013 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:19.531249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.531691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.532449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.532882 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.539794 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:19.540393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:19.546481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.547443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.547740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.548566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.730271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:19.738054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:19.739170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fda55af4-5db3-480e-8605-34f30601f107 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1721 microversion: 2.1 time: 0.219169 May 13 21:56:19.739749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 281/566] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:19 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:19.749202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:19.749202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:19.749613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4254e76f-2c0f-4839-80f1-92d3cb4c212e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1600 microversion: 2.20 time: 0.213426 May 13 21:56:19.750233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 286/567] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:56:19 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:56:19.771646 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:19.772135 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:19.777865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.778314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.779105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:19.779537 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:19.860997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1c4246bd-fbf2-4eaf-8be0-25f7c96bdb9e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093225 May 13 21:56:19.861863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 282/568] 10.222.0.35 () {60 vars in 1315 bytes} [Fri May 13 21:56:19 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:56:20.476958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:20.477568 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:20.484586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:20.485042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:20.485806 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:20.486239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:20.727072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:20.734686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b6f5d120-7c65-4742-b8b4-f75ebf87e96f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.261571 May 13 21:56:20.735280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 287/569] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:20 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:20.756704 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:20.757314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:20.763657 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:20.764104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:20.764860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:20.765297 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:20.952960 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-622b9a82-e883-4044-9f73-f68b566628af req-89d22c1d-21de-44b7-a322-3dee8c9e58ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:20.961611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:20.969302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c182b564-285f-4a30-914f-f3229be34934 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1721 microversion: 2.1 time: 0.216881 May 13 21:56:20.969870 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 283/570] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:20 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:20.972355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-622b9a82-e883-4044-9f73-f68b566628af req-89d22c1d-21de-44b7-a322-3dee8c9e58ab service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:20.972803 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-622b9a82-e883-4044-9f73-f68b566628af req-89d22c1d-21de-44b7-a322-3dee8c9e58ab service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:20.984037 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-622b9a82-e883-4044-9f73-f68b566628af req-89d22c1d-21de-44b7-a322-3dee8c9e58ab service nova] Creating event network-changed:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:56:20.989046 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-622b9a82-e883-4044-9f73-f68b566628af req-89d22c1d-21de-44b7-a322-3dee8c9e58ab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040279 May 13 21:56:20.989774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 288/571] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:21.397431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:21.398083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:21.404209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.405060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.405961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.406490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.433839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:56:21.508959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fb3ae95d-86bc-40b8-9831-b526b6f73e08 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 204 len: 0 microversion: 2.1 time: 0.115294 May 13 21:56:21.509776 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 284/572] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:56:21 2022] DELETE /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:56:21.520823 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:21.521811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:21.528586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.529318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.530319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.530973 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.668485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:21.676816 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c1319635-9e10-4209-97bd-339d6e069b12 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1577 microversion: 2.1 time: 0.160950 May 13 21:56:21.677388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 289/573] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:21 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:21.752229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:21.752954 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:21.759276 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.759859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.760407 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.760838 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.906484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:21.914196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-08cc213f-d736-4b1e-a667-c6cbbaba7a0f tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.166137 May 13 21:56:21.914784 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 285/574] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:21 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:21.986146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:21.987421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:21.993462 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.993922 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:21.994725 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:21.995173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.123173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:22.130804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-41acec7c-55d6-4867-b08e-eaf3a14e41bc tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1727 microversion: 2.1 time: 0.149293 May 13 21:56:22.131360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 290/575] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:21 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:22.147431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:22.147931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:22.154545 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.155035 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.156114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.156225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.232189 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a843831a-9504-4e60-8fcd-99fdca6761e0 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088525 May 13 21:56:22.232780 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 286/576] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 21:56:22 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:22.695316 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:22.695929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:22.703531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.703978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.704763 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.705198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.932081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:22.933449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:22.939578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.940477 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:22.941215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:22.941476 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:23.114519 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:23.121998 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e92577c1-bd7b-445a-978d-2c96cb29817d tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1577 microversion: 2.1 time: 0.430405 May 13 21:56:23.122578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 291/577] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:22 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1577 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:23.228001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:23.235689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2f976bb6-7a4c-494e-9262-fd71e17a942d tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.307846 May 13 21:56:23.236265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 287/578] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:22 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:23.537048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-a5004da6-83d2-40c2-8eec-2339ada16795 req-75d351f0-47f2-4518-ab4b-37c07cc592ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:23.545958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-a5004da6-83d2-40c2-8eec-2339ada16795 req-75d351f0-47f2-4518-ab4b-37c07cc592ce service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:23.546540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-a5004da6-83d2-40c2-8eec-2339ada16795 req-75d351f0-47f2-4518-ab4b-37c07cc592ce service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:23.559076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-a5004da6-83d2-40c2-8eec-2339ada16795 req-75d351f0-47f2-4518-ab4b-37c07cc592ce service nova] Creating event network-changed:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:56:23.566659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-a5004da6-83d2-40c2-8eec-2339ada16795 req-75d351f0-47f2-4518-ab4b-37c07cc592ce service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033347 May 13 21:56:23.567999 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 292/579] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:24.139200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:24.140480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:24.159802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:24.160460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:24.161250 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:24.161688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:24.254566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:24.255464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:24.261623 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:24.262145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:24.263670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:24.264204 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:24.538068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:24.545887 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9d5c8150-6502-441c-8cff-1076a3b732cd tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1577 microversion: 2.1 time: 0.410566 May 13 21:56:24.546766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 288/580] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:24 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1577 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:24.613890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:24.621908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-975e3504-e3b5-43a5-8c06-f23e8817076a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1756 microversion: 2.1 time: 0.372376 May 13 21:56:24.623091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 293/581] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:24 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1756 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:25.563016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:25.563735 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:25.570177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.570805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.572187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.572736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.581341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}, {"server_uuid": "95c1fa86-0199-416e-906e-ecbb3d1e510f", "name": "network-vif-deleted", "tag": "c4df6d51-ad13-478c-b857-3f2949f60980"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:25.591427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.591954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.604953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] Creating event network-changed:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:56:25.605808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] Creating event network-vif-deleted:c4df6d51-ad13-478c-b857-3f2949f60980 for instance 95c1fa86-0199-416e-906e-ecbb3d1e510f on hv-cinder-84051 May 13 21:56:25.613524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-a8662f38-5a8c-416c-914c-52b74a8ef31d req-5a851d03-2ca7-448f-b064-373f19f5097c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035596 May 13 21:56:25.614295 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 294/582] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:56:25.620963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.621416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.621894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lazy-loading 'fault' on Instance uuid 95c1fa86-0199-416e-906e-ecbb3d1e510f {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:56:25.639915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:25.640699 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:25.647419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.648135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.649148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:25.649742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:25.677039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:25.687190 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4ccd937d-7fb7-4912-86dd-fce5279eed3f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 200 len: 1229 microversion: 2.1 time: 0.128764 May 13 21:56:25.696531 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 289/583] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:25 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:25.816375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:25.824138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8f96c8f5-32c1-4e85-9875-91476e8c6323 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1759 microversion: 2.1 time: 0.188504 May 13 21:56:25.824711 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 295/584] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:25 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:56:26.704195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:26.704799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:26.711015 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:26.711462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:26.712217 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:26.712647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:26.725297 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] HTTP exception thrown: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Request method failure captured: May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f HTTP/1.1 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvoIodZq9E2xTTEf2HJazrVhJHJbUtRtbKNuFeeVI_EyleLglnyMnvk_KTuKqtm7fWKSgxnUZGGAmDKN12Cg05BOy1DJIpvd6NSX1VnKlTdXFkpe_B_wAoqqrq15Gjn_BXQcDhONAK5B5bwyxRZorGkywjupi0GnlsHQ5LqqA7jKg May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-TestVolumeBootPattern-572711134 May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:56:26.726908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2695816a7fb4bd7ab0ea420b156e6e6"}]}] May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-TestVolumeBootPattern-572711134 May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-TestVolumeBootPattern-572711134 May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-TestVolumeBootPattern-572711134-project May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: c3a0de9ca12746be893b97d3cd11b826 May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-TestVolumeBootPattern-572711134-project May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 21:56:26.728475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '95c1fa86-0199-416e-906e-ecbb3d1e510f'} May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:56:26.729405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 21:56:26.730624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:56:26.732324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Returning 404 to user: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:56:26.732324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-12b72b24-ebf5-461e-8bbc-ed097cd89204 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 404 len: 111 microversion: 2.1 time: 0.027934 May 13 21:56:26.732324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 290/585] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:26 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:56:26.819281 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-109650941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476909752", "security_groups": [{"name": "tempest-secgroup-smoke-1802433148"}], "block_device_mapping_v2": [{"uuid": "2c1ed20a-2301-4664-a5ae-128edadcd890", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db469d62-9f19-4947-a3c5-257e3bf41ebd"}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:26.926115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] validate_networks() for [('db469d62-9f19-4947-a3c5-257e3bf41ebd', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:56:27.281987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:56:27.282442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:56:27.282959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:56:27.283398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:56:27.283811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:56:27.292255 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:27.292707 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:27.293552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:27.293991 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:27.310014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:56:27.313908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for user c3a0de9ca12746be893b97d3cd11b826 and project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:56:27.369283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:56:27.371374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c1ed20a-2301-4664-a5ae-128edadcd890',volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:56:27.492672 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6af95f91-6975-46fc-9f68-a9627a4e5c48 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677136 May 13 21:56:27.493489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 296/586] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:56:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:56:27.503068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4879d841-8fdb-40a7-918a-bb6e1e338331 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:27.503677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4879d841-8fdb-40a7-918a-bb6e1e338331 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:27.560129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4879d841-8fdb-40a7-918a-bb6e1e338331 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:27.566984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4879d841-8fdb-40a7-918a-bb6e1e338331 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1093 microversion: 2.1 time: 0.067610 May 13 21:56:27.567550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 291/587] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:27 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:28.584046 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:28.584915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:28.591621 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:28.592071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:28.592831 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:28.593266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:28.668125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:28.675481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-dfeb30b1-381b-440a-8e6f-0a5b8c7a5889 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1209 microversion: 2.1 time: 0.095680 May 13 21:56:28.676227 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 297/588] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:28 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:29.693303 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:29.693919 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:29.702070 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:29.702787 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:29.703758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:29.704208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:29.898552 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:29.906641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-dc64118d-7c6c-470d-bb8e-e4c4420dc208 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.217606 May 13 21:56:29.907299 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 292/589] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:29 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:30.000797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-0847d814-24eb-4293-9adb-ba47d4ead7dc req-27db23b8-7a44-4ae8-af34-3850f3868aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b508c5-7d8a-4a7f-8732-c1b6d75f010c", "tag": "ae3ce264-7948-4690-9c35-37b75db494f0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:30.012880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-0847d814-24eb-4293-9adb-ba47d4ead7dc req-27db23b8-7a44-4ae8-af34-3850f3868aee service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:30.013668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-0847d814-24eb-4293-9adb-ba47d4ead7dc req-27db23b8-7a44-4ae8-af34-3850f3868aee service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:30.028208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-0847d814-24eb-4293-9adb-ba47d4ead7dc req-27db23b8-7a44-4ae8-af34-3850f3868aee service nova] Creating event network-changed:ae3ce264-7948-4690-9c35-37b75db494f0 for instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c on hv-cinder-84051 May 13 21:56:30.032833 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-0847d814-24eb-4293-9adb-ba47d4ead7dc req-27db23b8-7a44-4ae8-af34-3850f3868aee service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036263 May 13 21:56:30.033965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 298/590] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:56:30.923219 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:30.923829 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:30.930080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:30.930526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:30.931318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:30.931750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:31.144872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:31.152351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7fef0a02-b58b-45db-b10e-46eb9aea2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.233474 May 13 21:56:31.160015 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 293/591] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:30 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:32.171389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:32.172085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:32.178268 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:32.178729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:32.179508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:32.179986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:32.305867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:32.313485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3d4cd5fb-1f5a-49f8-9649-3c3cf1e040a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.146843 May 13 21:56:32.314047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 299/592] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:32 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:33.329381 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:33.329991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:33.336358 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:33.336814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:33.337583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:33.338025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:33.471108 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:33.478416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ace13373-be08-4a29-ac0d-c01b63e49c88 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.152894 May 13 21:56:33.479022 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 294/593] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:33 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:34.495914 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:34.496521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:34.503365 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:34.503801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:34.504551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:34.504979 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:34.629783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:34.636997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c3153907-5e91-46da-a0b7-835f7811e04a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.144927 May 13 21:56:34.638308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 300/594] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:34 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:35.654214 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:35.654916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:35.661061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:35.661512 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:35.662266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:35.662695 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:35.786729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:35.793855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-375707a0-6be3-4bc2-9b2e-38671d691674 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.144211 May 13 21:56:35.794414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 295/595] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:35 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:36.810176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:36.810741 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:36.817015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:36.817516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:36.818280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:36.818736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:36.946627 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:36.953869 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6549ab8b-e988-4e20-be65-63ce656b2df7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.147628 May 13 21:56:36.954444 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 301/596] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:36 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:37.970420 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:37.971124 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:37.977358 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:37.977802 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:37.978558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:37.979030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:38.285913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:38.293181 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1e4d440c-0d51-4a72-b872-359a1f40b61c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.326628 May 13 21:56:38.294393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 296/597] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:37 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:39.310001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:39.310606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:39.317158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:39.317606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:39.318376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:39.318829 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:39.511642 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:39.518793 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-259ff0bc-afcc-49e7-8929-f8a9815f76b1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.213244 May 13 21:56:39.519360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 302/598] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:39 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:40.534501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:40.535172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:40.541596 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:40.542037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:40.542837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:40.543272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:40.668062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:40.675176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-619ab6aa-cc17-4acb-bcc5-48de1416fe89 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.144540 May 13 21:56:40.675736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 297/599] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:40 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:41.288039 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-b0484f51-ba48-4875-9424-17ac3646f0b3 req-14388ddd-5cd1-4efe-bd9b-48e64d68344f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b508c5-7d8a-4a7f-8732-c1b6d75f010c", "name": "network-vif-plugged", "status": "completed", "tag": "ae3ce264-7948-4690-9c35-37b75db494f0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:41.296364 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b0484f51-ba48-4875-9424-17ac3646f0b3 req-14388ddd-5cd1-4efe-bd9b-48e64d68344f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:41.296803 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b0484f51-ba48-4875-9424-17ac3646f0b3 req-14388ddd-5cd1-4efe-bd9b-48e64d68344f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:41.307862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-b0484f51-ba48-4875-9424-17ac3646f0b3 req-14388ddd-5cd1-4efe-bd9b-48e64d68344f service nova] Creating event network-vif-plugged:ae3ce264-7948-4690-9c35-37b75db494f0 for instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c on hv-cinder-84051 May 13 21:56:41.313544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-b0484f51-ba48-4875-9424-17ac3646f0b3 req-14388ddd-5cd1-4efe-bd9b-48e64d68344f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029215 May 13 21:56:41.314144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 303/600] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:56:41.691515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:41.692120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:41.698289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:41.698760 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:41.699518 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:41.700266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:41.824557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:41.831763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a04e9652-c61e-476d-becc-a750c44ce1b0 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.144049 May 13 21:56:41.832319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 298/601] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:41 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:42.849310 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:42.849916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:42.856034 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:42.856487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:42.857253 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:42.857689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:42.988501 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:42.995872 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f6738db0-e551-4e98-9aec-fc5e4600f1f6 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1265 microversion: 2.1 time: 0.151305 May 13 21:56:42.996936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 304/602] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:42 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:44.013773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:44.014361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:44.020623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:44.021076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:44.021839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:44.022278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:44.153392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:44.160874 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ed7685b8-c018-4132-9083-d5cdd48812cc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1452 microversion: 2.1 time: 0.151457 May 13 21:56:44.161434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 299/603] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:44 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:44.176330 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:56:44.176978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:56:44.183241 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:44.183702 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:44.184981 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:44.185421 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:44.315882 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:56:44.325898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c1eef430-a209-4da7-aa6d-b6b33d024e8c tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1452 microversion: 2.1 time: 0.153325 May 13 21:56:44.326466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 305/604] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:56:44 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:56:46.183424 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-979a0858-7a6e-4d76-b139-648d3735d849 req-073d8561-0b2e-42ee-a338-0f60b6510d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b508c5-7d8a-4a7f-8732-c1b6d75f010c", "tag": "ae3ce264-7948-4690-9c35-37b75db494f0"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:56:46.192516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-979a0858-7a6e-4d76-b139-648d3735d849 req-073d8561-0b2e-42ee-a338-0f60b6510d97 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:56:46.192959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-979a0858-7a6e-4d76-b139-648d3735d849 req-073d8561-0b2e-42ee-a338-0f60b6510d97 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:56:46.203692 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-979a0858-7a6e-4d76-b139-648d3735d849 req-073d8561-0b2e-42ee-a338-0f60b6510d97 service nova] Creating event network-changed:ae3ce264-7948-4690-9c35-37b75db494f0 for instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c on hv-cinder-84051 May 13 21:56:46.208994 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-979a0858-7a6e-4d76-b139-648d3735d849 req-073d8561-0b2e-42ee-a338-0f60b6510d97 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029250 May 13 21:56:46.209579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 300/605] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:04.384140 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:04.384643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:04.390404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.390905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.391671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.392110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.414491 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-57779d88-b1a3-4944-a04a-f9f567e20adc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/ips" status: 200 len: 151 microversion: 2.20 time: 0.087062 May 13 21:57:04.415016 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 306/606] 10.222.0.35 () {60 vars in 1288 bytes} [Fri May 13 21:57:04 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/ips => generated 151 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:57:04.637710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:04.638389 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:04.645563 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.646043 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.646919 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.647431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.734094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lazy-loading 'services' on Instance uuid 3f33aec3-61e0-4d19-a71b-4335e1a37c28 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:57:04.802774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-05bc4aaa-4723-4d04-8dbf-bce08b3bd246 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments/1fa08a00-1749-4aa9-903a-fca0a3d6fbbc" status: 202 len: 0 microversion: 2.1 time: 0.169485 May 13 21:57:04.803458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 301/607] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 21:57:04 2022] DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments/1fa08a00-1749-4aa9-903a-fca0a3d6fbbc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:57:04.811972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:04.812978 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:04.819293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.819792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.820700 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:04.821409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:04.853451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-88f15ba6-7e55-4c34-88d4-7215f6031b1e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 May 13 21:57:04.854017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 307/608] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:04 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:05.383674 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-83901056"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:05.384287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:05.391133 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:05.391574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:05.392337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:05.392766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:05.519422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.network.security_group_api [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Removing security group 127fdbe8-6f69-4e2d-b327-1b5b465a5353 from port 4c96b3ab-f491-41d1-841b-d63a58be11a5 May 13 21:57:05.867179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:05.868818 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:05.874874 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:05.875329 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:05.876098 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:05.876534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:05.904778 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-dc764fcc-cf82-46e6-95f2-7c9300e1cc2b tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action" status: 202 len: 0 microversion: 2.1 time: 0.525321 May 13 21:57:05.905394 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 302/609] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 21:57:05 2022] POST /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:57:05.930397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-10762d0b-3921-4ed5-a745-f0a087320428 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068955 May 13 21:57:05.931241 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 308/610] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:05 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 21:57:06.002932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-f8f16a08-779b-4e47-bb05-86934911a1f7 req-fc49df26-9655-47d5-9ade-68976f4d08ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:06.012418 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f8f16a08-779b-4e47-bb05-86934911a1f7 req-fc49df26-9655-47d5-9ade-68976f4d08ff service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.013129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f8f16a08-779b-4e47-bb05-86934911a1f7 req-fc49df26-9655-47d5-9ade-68976f4d08ff service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.041712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-f8f16a08-779b-4e47-bb05-86934911a1f7 req-fc49df26-9655-47d5-9ade-68976f4d08ff service nova] Creating event network-changed:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:57:06.049760 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-f8f16a08-779b-4e47-bb05-86934911a1f7 req-fc49df26-9655-47d5-9ade-68976f4d08ff service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136589 May 13 21:57:06.053624 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:06.054351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:06.055104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 303/611] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:06.061704 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.062442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.063441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.063881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.106289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:57:06.247053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-99b5d767-635f-4221-b636-81e52350199d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 204 len: 0 microversion: 2.1 time: 0.196284 May 13 21:57:06.248014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 309/612] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:57:06 2022] DELETE /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 21:57:06.258335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:06.259422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:06.269752 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.270489 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.271767 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.272212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.466246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:06.474177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c2bd55b3-93ed-4ba6-8450-5b3117c7c798 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1687 microversion: 2.1 time: 0.221375 May 13 21:57:06.474744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 304/613] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:06 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:06.753889 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:06.754667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:06.760564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.761019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.761798 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:06.762238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:06.785100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lazy-loading 'flavor' on Instance uuid eb5ebcd4-056e-424e-9d5e-6cfef76036c3 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:57:07.040570 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5894cfa7-354e-46c5-92a8-15cd2bcc1a6c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/action" status: 202 len: 0 microversion: 2.20 time: 0.291268 May 13 21:57:07.041184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 310/614] 10.222.0.35 () {62 vars in 1318 bytes} [Fri May 13 21:57:06 2022] POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 21:57:07.050733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:07.051455 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:07.057776 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.058331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.059289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.059805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.215853 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:07.216444 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:07.224932 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.225354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.228059 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.228059 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.238259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:07.246495 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:07.248132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:07.249444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-da8a2248-50f5-4edd-997f-ef8429e26d5f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.204143 May 13 21:57:07.251078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 305/615] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:07 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:07.346888 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lazy-loading 'services' on Instance uuid c87e91d2-6f9b-41e7-bdf3-33a97de678a9 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:57:07.457207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8ee9a2c3-1fe7-47fe-a20f-fc139ecc3699 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments/4a3182d8-e1dd-4994-b8ec-72b91abce6a2" status: 202 len: 0 microversion: 2.1 time: 0.245593 May 13 21:57:07.457837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 311/616] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 21:57:07 2022] DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments/4a3182d8-e1dd-4994-b8ec-72b91abce6a2 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 21:57:07.466400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:07.467482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:07.474146 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.474601 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.475449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.475888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.491902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:07.492598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:07.498980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.499451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.500228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:07.500662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:07.507120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-079bab76-ec35-4b9d-ad9d-805cf305eb6c tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 May 13 21:57:07.507983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 306/617] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:07 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:07.636524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:07.643913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-dabb7fff-8369-439b-bfeb-722ec6341b8d tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1687 microversion: 2.1 time: 0.156247 May 13 21:57:07.644472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 312/618] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:07 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:08.068457 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-2784413b-3913-453a-95f8-995799684ebd req-107900d1-7eb2-43a3-8c56-ea2cccc2e031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:08.076969 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-2784413b-3913-453a-95f8-995799684ebd req-107900d1-7eb2-43a3-8c56-ea2cccc2e031 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.078158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-2784413b-3913-453a-95f8-995799684ebd req-107900d1-7eb2-43a3-8c56-ea2cccc2e031 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.089490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-2784413b-3913-453a-95f8-995799684ebd req-107900d1-7eb2-43a3-8c56-ea2cccc2e031 service nova] Creating event network-changed:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:57:08.094463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-2784413b-3913-453a-95f8-995799684ebd req-107900d1-7eb2-43a3-8c56-ea2cccc2e031 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029683 May 13 21:57:08.095104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 307/619] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:08.268212 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:08.268959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:08.275275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.275721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.276473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.276903 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.408851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:08.416495 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:08.417980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:08.419147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-971dc40c-47c5-49fb-8a7e-c87c37823b5e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.155473 May 13 21:57:08.419700 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 313/620] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:08 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:08.520236 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:08.521172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:08.527187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.527642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.528407 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.528848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.558270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a3e4ce72-dfae-4130-ad14-718cadccf467 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 May 13 21:57:08.559092 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 308/621] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:08 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:08.661537 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:08.662251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:08.668611 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.669052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.669802 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:08.670230 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:08.794507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:08.802215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0fba7afe-a524-456d-89f8-58106468dfc6 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1687 microversion: 2.1 time: 0.145159 May 13 21:57:08.802801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 314/622] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:08 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1687 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:09.437968 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:09.438576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:09.444865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.445319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.446081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.446519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.571745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:09.572367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:09.578931 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.579384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.580163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.580637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.587490 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:09.597097 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:09.599563 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:09.601492 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-db298ac7-ddb9-4c67-9d2a-f37ff2e30a85 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.166878 May 13 21:57:09.613689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 309/623] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:09 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:09.621408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-fa23a6c7-ff7e-4c99-8ade-a28544ca0232 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054460 May 13 21:57:09.621971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 315/624] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:09 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:09.818989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:09.819586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:09.825772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.826235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.827029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:09.827494 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:09.990227 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:09.997420 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fba9e5e5-0335-4818-a385-548f809dc631 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1687 microversion: 2.1 time: 0.182449 May 13 21:57:09.997966 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 310/625] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:09 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:10.620703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:10.621318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:10.628183 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:10.628919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:10.629709 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:10.630148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:10.635091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:10.636605 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:10.643749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:10.644205 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:10.644988 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:10.645429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:10.676336 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5a322158-3f05-42a1-b1ec-0d701514700a tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046208 May 13 21:57:10.676905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 311/626] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:10 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:11.015404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:11.016029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:11.022133 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.022590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.023392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.023837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.258418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:11.266848 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:11.268398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:11.269561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f5d2fb23-d950-4431-8f06-d7633731537e tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.652850 May 13 21:57:11.270339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 316/627] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:10 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:11.347938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:11.355469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-95c84fc9-0de6-4051-aa6a-a983c946af67 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1687 microversion: 2.1 time: 0.344508 May 13 21:57:11.356271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 312/628] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:11 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1687 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:11.688490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:11.689444 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:11.695751 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.696206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.696975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.697408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.725200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-af3468c8-f2c2-407e-a6d2-25cbe04be3e4 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041177 May 13 21:57:11.725773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 317/629] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:57:11 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 21:57:11.736334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:11.736864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:11.743177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.743633 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.744431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:11.744869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:11.820814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] HTTP exception thrown: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 is not attached to volume 4a3182d8-e1dd-4994-b8ec-72b91abce6a2 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Request method failure captured: May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments/4a3182d8-e1dd-4994-b8ec-72b91abce6a2 HTTP/1.1 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftOPkHv2rRhSea0rNsCamy4seUl9Q-aNp0IjDUNA2FGNiwub7pqvgrWt078I5tX-HjdxqRxfu7axHTejjXz2gWRjqk6_xuXbH_CAI0azGS7Of_LbiFoMhSLX92D4i1gkf_VNIitxItx8ftwkHcpJ0qYXfF4hnDgqll41seDswulKkPk May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: d37b24e8a85f49ce9d043e8a38b8748f May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:57:11.836939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d37b24e8a85f49ce9d043e8a38b8748f"}]}] May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: d37b24e8a85f49ce9d043e8a38b8748f May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-TestMinimumBasicScenario-685481083-project May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 4812f8677a754dcd9e7a5607c643e8cb May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-TestMinimumBasicScenario-685481083-project May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:57:11.838451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 is not attached to volume 4a3182d8-e1dd-4994-b8ec-72b91abce6a2 May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'server_id': 'c87e91d2-6f9b-41e7-bdf3-33a97de678a9', 'id': '4a3182d8-e1dd-4994-b8ec-72b91abce6a2'} May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4a3182d8-e1dd-4994-b8ec-72b91abce6a2. May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:57:11.839871 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 is not attached to volume 4a3182d8-e1dd-4994-b8ec-72b91abce6a2 May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 is not attached to volume 4a3182d8-e1dd-4994-b8ec-72b91abce6a2 May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:11.842017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Returning 404 to user: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 is not attached to volume 4a3182d8-e1dd-4994-b8ec-72b91abce6a2 {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:57:11.844312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1e08b680-6d2e-4510-ad2d-7f15f616c0bd tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments/4a3182d8-e1dd-4994-b8ec-72b91abce6a2" status: 404 len: 154 microversion: 2.1 time: 0.106944 May 13 21:57:11.844312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 313/630] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 21:57:11 2022] DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9/os-volume_attachments/4a3182d8-e1dd-4994-b8ec-72b91abce6a2 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 21:57:12.288455 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:12.289061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:12.294949 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-d12f54d2-0b34-43cc-9e5a-3d15e3422970 req-63ca3b48-15db-4eb3-8730-249984fede56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f33aec3-61e0-4d19-a71b-4335e1a37c28", "name": "network-vif-deleted", "tag": "32691995-0573-40f8-aaf1-a4ed6f867bf7"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:12.303661 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.304076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.305090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.305325 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d12f54d2-0b34-43cc-9e5a-3d15e3422970 req-63ca3b48-15db-4eb3-8730-249984fede56 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.305484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.305837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d12f54d2-0b34-43cc-9e5a-3d15e3422970 req-63ca3b48-15db-4eb3-8730-249984fede56 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.325647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-d12f54d2-0b34-43cc-9e5a-3d15e3422970 req-63ca3b48-15db-4eb3-8730-249984fede56 service nova] Creating event network-vif-deleted:32691995-0573-40f8-aaf1-a4ed6f867bf7 for instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 on hv-cinder-84051 May 13 21:57:12.333392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-d12f54d2-0b34-43cc-9e5a-3d15e3422970 req-63ca3b48-15db-4eb3-8730-249984fede56 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044584 May 13 21:57:12.334186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 314/631] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:12.375225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:12.377038 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:12.386615 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.387100 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.387875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.388314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.482925 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:12.489682 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:12.493283 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-05388d28-28d2-4ab9-a913-c17c55720521 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 200 len: 1329 microversion: 2.1 time: 0.123876 May 13 21:57:12.493912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 315/632] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:12 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:12.498412 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:12.503694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:12.504867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-93049e5f-4334-4885-9eb0-026c04acc824 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.220780 May 13 21:57:12.505427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 318/633] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:12 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:12.974637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:12.975192 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:12.982390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.982890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:12.983704 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:12.984147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.011242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:57:13.087813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-838825b0-7b2e-4a10-ba1f-169c664f15ca tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 204 len: 0 microversion: 2.1 time: 0.116883 May 13 21:57:13.088765 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 316/634] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:57:12 2022] DELETE /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:57:13.097802 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:13.098564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:13.105180 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.105635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.106437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.106901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.244189 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:13.251667 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1a06c401-9da7-43ea-9284-e9a73184d808 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1555 microversion: 2.1 time: 0.158394 May 13 21:57:13.252439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 319/635] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:13 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:13.509849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:13.510542 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 3f33aec3-61e0-4d19-a71b-4335e1a37c28] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:13.517195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.517654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.518430 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.518899 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.522859 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:13.523487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:13.529388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.529827 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.530637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:13.531104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:13.538663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] HTTP exception thrown: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Request method failure captured: May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 HTTP/1.1 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL6obtLfoMakldR6LzjoEXadqit41RP1TrdbbcjtNpiAXkZsqTgRzLC2AEGm9VaL6QSK4iwx3ZJBYbrG3e3Vi-_1uGU_N7L8E0jn1VdsUyUqgMbdl_J22hiDw6XPuIENkCKnExuyTiyyxgYwlGR92lsbysvJuipuFRsdhtxEFupi1k May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:57:13.540481 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_428d047f511945e5bdf35eb8ed236507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/428d047f511945e5bdf35eb8ed236507"}]}] May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 6b11a3de8b71482594a04ab7e53a94bd May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. May 13 21:57:13.541846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '3f33aec3-61e0-4d19-a71b-4335e1a37c28'} May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:57:13.542618 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. May 13 21:57:13.543888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:13.545047 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Returning 404 to user: Instance 3f33aec3-61e0-4d19-a71b-4335e1a37c28 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:57:13.545047 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4f06e54d-4f51-4a5a-8a78-dbf6911e6279 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28" status: 404 len: 111 microversion: 2.1 time: 0.036309 May 13 21:57:13.545047 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 317/636] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:13 2022] GET /compute/v2.1/servers/3f33aec3-61e0-4d19-a71b-4335e1a37c28 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:57:13.550387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8af427f1-1d73-466d-adc5-b2a840787c02 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '.version_select at 0x7fb7d6e25310>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:13.568732 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8af427f1-1d73-466d-adc5-b2a840787c02 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92307404" status: 202 len: 0 microversion: 2.1 time: 0.021800 May 13 21:57:13.569298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 318/637] 10.222.0.35 () {58 vars in 1214 bytes} [Fri May 13 21:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92307404 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:57:13.663592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:13.672357 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:13.673863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:13.675247 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d3ed42a2-e08d-4c55-9559-4818e9b28f5c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.156369 May 13 21:57:13.675813 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 320/638] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:13 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:14.269184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:14.269803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:14.276773 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:14.277370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:14.278143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:14.278713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:14.402571 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:14.410306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-645e98d6-2605-4f71-9941-9610a5a14b96 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1555 microversion: 2.1 time: 0.145159 May 13 21:57:14.410894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 319/639] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:14 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:14.693019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:14.693633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:14.701054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:14.701521 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:14.702829 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:14.703274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:14.828637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:14.836407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:14.837898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:14.839082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e85dc600-53d6-4547-8103-f546802d2258 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.149985 May 13 21:57:14.839648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 321/640] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:14 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:15.427400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:15.428004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:15.433978 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:15.434426 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:15.435484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:15.436111 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:15.445839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-347a2277-b11f-4c71-8772-6a2a9e9dee56 req-ffa51ed2-28b7-4879-abca-0b1a93a89157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e91d2-6f9b-41e7-bdf3-33a97de678a9", "name": "network-vif-deleted", "tag": "4c96b3ab-f491-41d1-841b-d63a58be11a5"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:15.457345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-347a2277-b11f-4c71-8772-6a2a9e9dee56 req-ffa51ed2-28b7-4879-abca-0b1a93a89157 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:15.458056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-347a2277-b11f-4c71-8772-6a2a9e9dee56 req-ffa51ed2-28b7-4879-abca-0b1a93a89157 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:15.470771 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-347a2277-b11f-4c71-8772-6a2a9e9dee56 req-ffa51ed2-28b7-4879-abca-0b1a93a89157 service nova] Creating event network-vif-deleted:4c96b3ab-f491-41d1-841b-d63a58be11a5 for instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 on hv-cinder-84051 May 13 21:57:15.476885 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-347a2277-b11f-4c71-8772-6a2a9e9dee56 req-ffa51ed2-28b7-4879-abca-0b1a93a89157 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034848 May 13 21:57:15.478605 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 322/641] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:15.505312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4812f8677a754dcd9e7a5607c643e8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37b24e8a85f49ce9d043e8a38b8748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:15.512972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-47936adf-9e84-49d9-ac6e-e8ffba590baf tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 200 len: 1513 microversion: 2.1 time: 0.089357 May 13 21:57:15.513474 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 320/642] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:15 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 1513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:15.857955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:15.858662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:15.866110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:15.866557 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:15.867351 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:15.867789 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.000593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:16.008685 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:16.010375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:16.011761 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9084ffe3-0e23-4985-891f-2b4281959816 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.158305 May 13 21:57:16.012345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 323/643] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:15 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:16.401869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:16.402408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:16.408257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.408659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.409418 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.409861 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.433562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:57:16.506787 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-020bcc9d-1eb3-4925-97ca-d556481076ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 204 len: 0 microversion: 2.1 time: 0.108364 May 13 21:57:16.507549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 321/644] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:57:16 2022] DELETE /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:57:16.516302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:16.516918 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:16.522823 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.523279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.524050 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.524746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.530163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:16.530903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] [instance: c87e91d2-6f9b-41e7-bdf3-33a97de678a9] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:16.536548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.536990 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.537745 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:16.538176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:16.551123 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] HTTP exception thrown: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Request method failure captured: May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 HTTP/1.1 May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftOPkHv2rRhSea0rNsCamy4seUl9Q-aNp0IjDUNA2FGNiwub7pqvgrWt078I5tX-HjdxqRxfu7axHTejjXz2gWRjqk6_xuXbH_CAI0azGS7Of_LbiFoMhSLX92D4i1gkf_VNIitxItx8ftwkHcpJ0qYXfF4hnDgqll41seDswulKkPk May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: d37b24e8a85f49ce9d043e8a38b8748f May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:57:16.552738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_d37b24e8a85f49ce9d043e8a38b8748f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/d37b24e8a85f49ce9d043e8a38b8748f"}]}] May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: d37b24e8a85f49ce9d043e8a38b8748f May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-TestMinimumBasicScenario-685481083 May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-TestMinimumBasicScenario-685481083-project May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 4812f8677a754dcd9e7a5607c643e8cb May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-TestMinimumBasicScenario-685481083-project May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. May 13 21:57:16.554264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c87e91d2-6f9b-41e7-bdf3-33a97de678a9'} May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:57:16.555272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. May 13 21:57:16.556839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:16.558589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Returning 404 to user: Instance c87e91d2-6f9b-41e7-bdf3-33a97de678a9 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:57:16.558589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-dcb8eb64-d36f-4d43-ad30-c05e6c568605 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9" status: 404 len: 111 microversion: 2.1 time: 0.028301 May 13 21:57:16.558589 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 322/645] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:16 2022] GET /compute/v2.1/servers/c87e91d2-6f9b-41e7-bdf3-33a97de678a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 21:57:16.564267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-20426f45-3c0a-4ffc-986e-a6708772a0b7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] Calling method '.version_select at 0x7fb7d6e259d0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:16.581615 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-20426f45-3c0a-4ffc-986e-a6708772a0b7 tempest-TestMinimumBasicScenario-685481083 tempest-TestMinimumBasicScenario-685481083-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1248043653" status: 202 len: 0 microversion: 2.1 time: 0.022022 May 13 21:57:16.582371 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 323/646] 10.222.0.35 () {58 vars in 1271 bytes} [Fri May 13 21:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1248043653 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 21:57:16.661548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:16.668916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-90f3be34-9c9b-4678-8af6-2633433a76fe tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1507 microversion: 2.1 time: 0.157067 May 13 21:57:16.669486 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 324/647] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:16 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:17.030685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:17.031926 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:17.037659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:17.038106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:17.038902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:17.039340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:17.171001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:17.182099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:17.184011 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:17.185182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-9f206108-275b-4722-9ca4-d3168ec1137a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.158491 May 13 21:57:17.185763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 324/648] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:17 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:17.685903 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:17.686512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:17.693671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:17.694124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:17.694958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:17.695397 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:18.015066 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:18.022308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c513737a-87e4-4645-a124-5618dd2fae90 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1507 microversion: 2.1 time: 0.340331 May 13 21:57:18.022928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 325/649] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:17 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:18.203899 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:18.204501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:18.210912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:18.211362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:18.212126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:18.212560 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:18.422415 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:18.430124 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:18.431646 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:18.432770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-86236ed5-3834-42ab-9514-e307abe07a06 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.233284 May 13 21:57:18.433324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 325/650] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:18 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:19.039016 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:19.039819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:19.046021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:19.046472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:19.047804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:19.048296 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:19.348719 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:19.358975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d43472c0-6fcb-425b-b9d3-659770d6fc7e tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 200 len: 1507 microversion: 2.1 time: 0.323670 May 13 21:57:19.363646 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 326/651] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:19 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:19.373206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-a3e37cbf-65ac-49d1-9af3-a7077aef36a8 req-f6505f52-30be-4491-b137-8780d5556466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fde36f-b050-42de-b5cb-b2914bc8f572", "name": "network-vif-deleted", "tag": "e3fd2642-2b5f-482d-a83d-cd9af96786c4"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:19.386519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-a3e37cbf-65ac-49d1-9af3-a7077aef36a8 req-f6505f52-30be-4491-b137-8780d5556466 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:19.387234 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-a3e37cbf-65ac-49d1-9af3-a7077aef36a8 req-f6505f52-30be-4491-b137-8780d5556466 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:19.401460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-a3e37cbf-65ac-49d1-9af3-a7077aef36a8 req-f6505f52-30be-4491-b137-8780d5556466 service nova] Creating event network-vif-deleted:e3fd2642-2b5f-482d-a83d-cd9af96786c4 for instance 91fde36f-b050-42de-b5cb-b2914bc8f572 on hv-cinder-84051 May 13 21:57:19.408401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-a3e37cbf-65ac-49d1-9af3-a7077aef36a8 req-f6505f52-30be-4491-b137-8780d5556466 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043018 May 13 21:57:19.409575 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 326/652] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:19.451516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:19.452363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:19.459075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:19.459524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:19.460292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:19.460723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:19.651293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:19.662094 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:19.664180 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:19.666391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-aa2d0ee1-3523-4bc2-9f5c-2d57063298b1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.217906 May 13 21:57:19.678034 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 327/653] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:19 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:20.379832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:20.380519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 91fde36f-b050-42de-b5cb-b2914bc8f572] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:20.387036 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.387479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.388234 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.388666 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.401896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] HTTP exception thrown: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Request method failure captured: May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 HTTP/1.1 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL6obtLfoMakldR6LzjoEXadqit41RP1TrdbbcjtNpiAXkZsqTgRzLC2AEGm9VaL6QSK4iwx3ZJBYbrG3e3Vi-_1uGU_N7L8E0jn1VdsUyUqgMbdl_J22hiDw6XPuIENkCKnExuyTiyyxgYwlGR92lsbysvJuipuFRsdhtxEFupi1k May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:57:20.403556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_428d047f511945e5bdf35eb8ed236507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/428d047f511945e5bdf35eb8ed236507"}]}] May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 6b11a3de8b71482594a04ab7e53a94bd May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. May 13 21:57:20.405337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '91fde36f-b050-42de-b5cb-b2914bc8f572'} May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:57:20.406182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. May 13 21:57:20.407607 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:57:20.408805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Returning 404 to user: Instance 91fde36f-b050-42de-b5cb-b2914bc8f572 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:57:20.408805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f82fbab3-53fa-41c2-9640-e1f5bf5060eb tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572" status: 404 len: 111 microversion: 2.1 time: 0.029896 May 13 21:57:20.408805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 327/654] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:20 2022] GET /compute/v2.1/servers/91fde36f-b050-42de-b5cb-b2914bc8f572 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:57:20.413747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:20.414233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:20.421234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.422201 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.423053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.423476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.449526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:57:20.526350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d20cf901-7079-4699-a62c-823d205cc094 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "DELETE /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 204 len: 0 microversion: 2.1 time: 0.116330 May 13 21:57:20.530561 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 328/655] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:57:20 2022] DELETE /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 21:57:20.535351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:20.536184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:20.541933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.542377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.543207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.543637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.687005 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:20.688340 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:20.701592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.702146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.703104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:20.703632 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:20.720895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:20.733616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ed15ad51-c8bb-4640-b4b4-2d40d4990371 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.202187 May 13 21:57:20.735447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 328/656] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:20 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:20.867901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:20.875945 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:20.877435 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:20.878623 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3d61dcf7-68ea-44cc-869d-43519d486203 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.197482 May 13 21:57:20.879210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 329/657] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:20 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:21.751639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:21.752251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:21.758450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:21.759141 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:21.759906 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:21.760340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:21.897018 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:21.897621 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:21.903873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:21.904319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:21.905076 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:21.905503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:21.999373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:22.007057 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1cdb17c1-acd1-4e25-a747-6c2051e830ff tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.260015 May 13 21:57:22.007556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 329/658] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:21 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:22.145452 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:22.153302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:22.154835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:22.156021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-524d1fa2-bd2c-4422-af3f-3925d79b948c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.262888 May 13 21:57:22.156585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 330/659] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:21 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:23.024934 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:23.026150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:23.035628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:23.036305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:23.037443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:23.038049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:23.173406 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:23.174027 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:23.181955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:23.182420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:23.191720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:23.193079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:23.360386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11a3de8b71482594a04ab7e53a94bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428d047f511945e5bdf35eb8ed236507', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:23.369665 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-84239df7-4a87-4755-8b37-5e20b55d7611 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 200 len: 1522 microversion: 2.1 time: 0.348676 May 13 21:57:23.371233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 330/660] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:23 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:23.441308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:23.455572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:23.457515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:23.459004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-26038296-0315-427e-aec0-a5d65fda6d71 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.289413 May 13 21:57:23.459949 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 331/661] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:23 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:23.691732 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-b53d9a90-04ab-429d-bca9-fdd11a29602a req-0e38a7b4-5177-4195-a979-65d790b02536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f3e7ea-df2f-4358-a44c-ea4e9520b05c", "name": "network-vif-deleted", "tag": "c3aa6bb9-4ce2-4adf-953e-16d164392134"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:23.702055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b53d9a90-04ab-429d-bca9-fdd11a29602a req-0e38a7b4-5177-4195-a979-65d790b02536 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:23.703088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b53d9a90-04ab-429d-bca9-fdd11a29602a req-0e38a7b4-5177-4195-a979-65d790b02536 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:23.715823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-b53d9a90-04ab-429d-bca9-fdd11a29602a req-0e38a7b4-5177-4195-a979-65d790b02536 service nova] Creating event network-vif-deleted:c3aa6bb9-4ce2-4adf-953e-16d164392134 for instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c on hv-cinder-84051 May 13 21:57:23.721931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-b53d9a90-04ab-429d-bca9-fdd11a29602a req-0e38a7b4-5177-4195-a979-65d790b02536 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 May 13 21:57:23.727095 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 331/662] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:24.387954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:24.388655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] [instance: 80f3e7ea-df2f-4358-a44c-ea4e9520b05c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:24.395508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:24.396035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:24.396801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:24.397240 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:24.410854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] HTTP exception thrown: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Request method failure captured: May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c HTTP/1.1 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftL6obtLfoMakldR6LzjoEXadqit41RP1TrdbbcjtNpiAXkZsqTgRzLC2AEGm9VaL6QSK4iwx3ZJBYbrG3e3Vi-_1uGU_N7L8E0jn1VdsUyUqgMbdl_J22hiDw6XPuIENkCKnExuyTiyyxgYwlGR92lsbysvJuipuFRsdhtxEFupi1k May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:57:24.412497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/428d047f511945e5bdf35eb8ed236507"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_428d047f511945e5bdf35eb8ed236507"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/428d047f511945e5bdf35eb8ed236507"}]}] May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 428d047f511945e5bdf35eb8ed236507 May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-936463343 May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 6b11a3de8b71482594a04ab7e53a94bd May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-936463343-project May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. May 13 21:57:24.414162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '80f3e7ea-df2f-4358-a44c-ea4e9520b05c'} May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:57:24.414986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. May 13 21:57:24.416251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:57:24.417283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] Returning 404 to user: Instance 80f3e7ea-df2f-4358-a44c-ea4e9520b05c could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:57:24.417283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a6ef97d0-704e-4caf-b7e0-510aad100dc4 tempest-ServerRescueNegativeTestJSON-936463343 tempest-ServerRescueNegativeTestJSON-936463343-project] 10.222.0.35 "GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c" status: 404 len: 111 microversion: 2.1 time: 0.029850 May 13 21:57:24.417283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 332/663] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:24 2022] GET /compute/v2.1/servers/80f3e7ea-df2f-4358-a44c-ea4e9520b05c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:57:24.477783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:24.479136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:24.485630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:24.486076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:24.486943 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:24.487397 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:24.694335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:24.707799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:24.710861 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:24.714465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ecd3a971-41c6-4aac-b64f-59183e2b3f9f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.240729 May 13 21:57:24.716151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 332/664] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:24 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:25.733288 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:25.734009 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:25.740428 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:25.742720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:25.743587 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:25.744035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:25.931446 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:25.940021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:25.941549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:25.942873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5ffe358e-13b8-4beb-b2da-23d88535c0e3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1745 microversion: 2.20 time: 0.213263 May 13 21:57:25.943422 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 333/665] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:25 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:26.961306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:26.962510 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:26.969959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:26.970877 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:26.971819 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:26.972406 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:27.138531 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:27.147685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:27.150260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:27.151659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-84dfeea9-6fb8-433d-894a-d9a6743880b5 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.194312 May 13 21:57:27.152414 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 333/666] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:26 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:28.172458 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:28.173075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:28.181865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:28.182321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:28.191001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:28.191683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:28.367228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:28.377068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:28.377068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:28.378929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-57a8ae26-1fcd-4ccc-bae3-7ba76c8142d8 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.211875 May 13 21:57:28.379613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 334/667] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:28 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:29.397210 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:29.397828 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:29.407875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:29.408632 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:29.409623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:29.410352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:29.632299 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:29.641208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:29.642733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:29.643920 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fc34bbcb-e042-47f7-8d52-016e42d039d0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.250551 May 13 21:57:29.644479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 334/668] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:29 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:29.848440 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-3f3addfb-7eed-46b3-870a-ca243bb75b9f req-f5adffda-9789-45f2-abb9-9fbdf1ce4391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "name": "network-vif-plugged", "status": "completed", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:29.857391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-3f3addfb-7eed-46b3-870a-ca243bb75b9f req-f5adffda-9789-45f2-abb9-9fbdf1ce4391 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:29.858099 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-3f3addfb-7eed-46b3-870a-ca243bb75b9f req-f5adffda-9789-45f2-abb9-9fbdf1ce4391 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:29.870964 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-3f3addfb-7eed-46b3-870a-ca243bb75b9f req-f5adffda-9789-45f2-abb9-9fbdf1ce4391 service nova] Creating event network-vif-plugged:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:57:29.877640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-3f3addfb-7eed-46b3-870a-ca243bb75b9f req-f5adffda-9789-45f2-abb9-9fbdf1ce4391 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310417 May 13 21:57:29.879101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 335/669] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:57:30.662927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:30.663540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:30.670698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:30.672082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:30.673065 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:30.673518 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:30.861846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:30.870417 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:30.872268 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:30.873867 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1a140d79-d7e8-4d50-8777-8e714d1e5674 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.215311 May 13 21:57:30.874676 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 335/670] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:30 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:31.894776 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:31.896427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:31.911342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:31.911845 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:31.912697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:31.924942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:32.186821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:32.203943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:32.208142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:32.211355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a3690a21-1a59-428b-beee-8c7376521778 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.321816 May 13 21:57:32.212666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 336/671] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:31 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:33.232833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:33.233448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:33.245356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:33.250267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:33.251239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:33.251888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:33.511232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:33.521998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:33.523852 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:33.527437 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-12023bd3-35e0-434e-a21f-e00043fd7b16 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.301889 May 13 21:57:33.541602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 336/672] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:33 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:34.549602 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:34.550870 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:34.561616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:34.562614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:34.570147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:34.570748 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:34.882625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:34.892437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:34.893947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:34.895159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5d062bca-82a7-49cd-a1aa-a046068bf1e4 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.349830 May 13 21:57:34.905874 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 337/673] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:34 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:35.916331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:35.916979 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:35.924913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:35.925362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:35.926143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:35.926580 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:36.013184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0e3293df-5873-401a-9fda-fbc084f7866f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: .version_select at 0x7fb7dfffa3a0>, body: {"keypair": {"name": "tempest-keypair-1354241518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQp5fD/BwkIUE2vl7DzbsCs+YT/M48Ta81qWbxfG602X8nd8r0mqSQVcfi/bCF6pRqFXdVQDDnQftCcJCneXXf3eI49cOWvwn0ZpccTR16djMJn6JKi9KSosLtrAsvhzQ=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:36.047673 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-0e3293df-5873-401a-9fda-fbc084f7866f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:57:36.055034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-0e3293df-5873-401a-9fda-fbc084f7866f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:57:36.088803 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:36.098378 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:36.099258 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0e3293df-5873-401a-9fda-fbc084f7866f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276116 May 13 21:57:36.099866 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 337/674] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:57:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:36.101237 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:36.102592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c8f9b897-34ed-46d4-abd2-5ef53ed3d32b tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.190276 May 13 21:57:36.103630 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 338/675] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:35 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:37.121897 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:37.123375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:37.131395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:37.132082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:37.133157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:37.133699 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:37.326522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:37.338911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:37.340938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:37.345896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c29eff5a-27ad-4c8d-857f-fb2a2c390a73 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.228278 May 13 21:57:37.346806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 338/676] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:37 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:37.760228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-553272615", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb86270-54c5-4ed6-9100-3db6f56fe50f"}], "security_groups": [{"name": "tempest-securitygroup--1905115238"}], "key_name": "tempest-keypair-1354241518", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:37.875618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] validate_networks() for [('ffb86270-54c5-4ed6-9100-3db6f56fe50f', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:57:38.366431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:38.367753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:38.374456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:38.374950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:38.375903 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:38.376501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:38.558097 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:57:38.558826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:57:38.559475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:57:38.560179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:57:38.560490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:57:38.577989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:38.578442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:38.579307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:38.579691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:38.621803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:38.630473 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:38.636642 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:57:38.637906 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:38.641879 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7d1af488-753c-478e-8679-d944fcc95213 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1740 microversion: 2.20 time: 0.279202 May 13 21:57:38.643410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:57:38.652993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 339/677] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:38 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:38.672282 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:57:38.675866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:57:38.760382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b6e64475-6517-4b6b-b35f-0f393cc71512 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.004341 May 13 21:57:38.767067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 339/678] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:57:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:57:38.771645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0995e506-9d98-464c-b1df-9ce9d7fa5477 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:38.772509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0995e506-9d98-464c-b1df-9ce9d7fa5477 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:38.881988 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0995e506-9d98-464c-b1df-9ce9d7fa5477 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:38.898469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0995e506-9d98-464c-b1df-9ce9d7fa5477 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1241 microversion: 2.1 time: 0.130430 May 13 21:57:38.899771 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 340/679] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:38 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:39.661442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:39.662371 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:39.671592 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:39.672393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:39.673269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:39.673773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:39.917716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:39.918339 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:39.926435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:39.928288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:39.929748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:39.930202 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:40.137460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:40.144081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f1a45453-0e75-4c17-9659-e94245f29649 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1293 microversion: 2.1 time: 0.231920 May 13 21:57:40.153393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 341/680] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:39 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:40.153841 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:40.158927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:40.160420 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:40.161579 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f98a66c5-e56c-4d18-871f-954367465af3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1722 microversion: 2.20 time: 0.504699 May 13 21:57:40.162134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 340/681] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:39 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1722 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:41.161606 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:41.162301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:41.168522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:41.168970 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:41.169733 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:41.170162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:41.179615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:41.180311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:41.187187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:41.187610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:41.188585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:41.189080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:41.254313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:41.262251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3ebd31b6-5c58-4fdd-9407-06b5d88abaf8 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1299 microversion: 2.1 time: 0.104433 May 13 21:57:41.271694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 342/682] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:41 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:41.378056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:41.385953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:41.387480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:41.388629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bd5c67a5-c779-446d-9cae-b5f348fd8114 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1722 microversion: 2.20 time: 0.213040 May 13 21:57:41.389194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 341/683] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:41 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:42.279365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:42.279977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:42.286998 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:42.287398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:42.288164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:42.288604 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:42.408132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:42.408738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:42.414002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:42.415036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:42.415488 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:42.416253 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:42.416688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:42.421526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6ff5a679-e82e-4e42-98ad-bc1448cb21f4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.145988 May 13 21:57:42.422084 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 343/684] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:42 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:42.576334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:42.584786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:42.586267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:42.587430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-19034ee3-9c7d-4f8e-9be8-36c0a8894c03 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1722 microversion: 2.20 time: 0.184064 May 13 21:57:42.587984 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 342/685] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:42 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:43.172426 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-875f166c-7bb0-4da5-915b-dd7f0a791665 req-fe251f58-88f7-4bc2-9689-d6ae4c9fa65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ae0672-baa5-43cc-afeb-8a1bb179818b", "tag": "df1579fd-2e1e-49df-91d6-e984e0f5c5ad"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:43.181822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-875f166c-7bb0-4da5-915b-dd7f0a791665 req-fe251f58-88f7-4bc2-9689-d6ae4c9fa65d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.182569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-875f166c-7bb0-4da5-915b-dd7f0a791665 req-fe251f58-88f7-4bc2-9689-d6ae4c9fa65d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.194847 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-875f166c-7bb0-4da5-915b-dd7f0a791665 req-fe251f58-88f7-4bc2-9689-d6ae4c9fa65d service nova] Creating event network-changed:df1579fd-2e1e-49df-91d6-e984e0f5c5ad for instance c7ae0672-baa5-43cc-afeb-8a1bb179818b on hv-cinder-84051 May 13 21:57:43.201020 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-875f166c-7bb0-4da5-915b-dd7f0a791665 req-fe251f58-88f7-4bc2-9689-d6ae4c9fa65d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 May 13 21:57:43.205138 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 344/686] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:43.437564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:43.438179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:43.444571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.445037 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.445815 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.446260 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.503454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-8c48f102-1ca3-4911-8939-013310e0a881 req-3ea67f8f-901d-4ccf-a7aa-8f414450018a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "name": "network-vif-unplugged", "status": "completed", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:43.513370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8c48f102-1ca3-4911-8939-013310e0a881 req-3ea67f8f-901d-4ccf-a7aa-8f414450018a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.513817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-8c48f102-1ca3-4911-8939-013310e0a881 req-3ea67f8f-901d-4ccf-a7aa-8f414450018a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.525362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.compute.server_external_events [req-8c48f102-1ca3-4911-8939-013310e0a881 req-3ea67f8f-901d-4ccf-a7aa-8f414450018a service nova] Unable to find a host for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3. Dropping event network-vif-unplugged {{(pid=128489) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 21:57:43.526509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-8c48f102-1ca3-4911-8939-013310e0a881 req-3ea67f8f-901d-4ccf-a7aa-8f414450018a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028908 May 13 21:57:43.527153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 345/687] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 13 21:57:43.605422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:43.606655 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:43.613545 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.613996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.614790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.615228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.694341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:43.705459 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a317e1b9-2a1d-4f02-b7cb-fe32a12b7d31 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.271690 May 13 21:57:43.706150 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 343/688] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:43 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:43.770215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:43.777799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:43.779312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:43.781197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d2eb2f34-423f-48fc-b405-2b20aca48a19 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1665 microversion: 2.20 time: 0.178984 May 13 21:57:43.781747 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 346/689] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:43 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:43.798412 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdc125d3-a704-4740-bb01-cfb341cd4a3f"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:43.799593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:43.805383 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.805832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:43.806585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:43.807056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.056781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a826eb5d-291c-43c6-97ab-c135c31076d7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.262088 May 13 21:57:44.057517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 344/690] 10.222.0.35 () {62 vars in 1363 bytes} [Fri May 13 21:57:43 2022] POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments => generated 188 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 21:57:44.166283 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:44.166824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:44.173321 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.173769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.174528 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.174991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.425590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-06c2f6e9-e957-4324-bbe0-9b9f2711148c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments/fdc125d3-a704-4740-bb01-cfb341cd4a3f" status: 202 len: 0 microversion: 2.20 time: 0.263190 May 13 21:57:44.426177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 347/691] 10.222.0.35 () {60 vars in 1456 bytes} [Fri May 13 21:57:44 2022] DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments/fdc125d3-a704-4740-bb01-cfb341cd4a3f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 21:57:44.479668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:44.480207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:44.487465 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.487943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.488712 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.489144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.566728 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0c63ef0c-4765-49a3-a1ce-4dcbadc6a2de tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/action" status: 202 len: 0 microversion: 2.20 time: 0.090777 May 13 21:57:44.567243 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 345/692] 10.222.0.35 () {62 vars in 1318 bytes} [Fri May 13 21:57:44 2022] POST /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 21:57:44.575630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:44.576000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:44.582466 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.582941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.583710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.584141 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.722799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:44.723445 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:44.729265 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.729797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.730504 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:44.730979 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:44.808608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:44.817697 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:44.819232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:44.820402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2a1d44a2-abe8-45b9-9ddb-a2b8b784ca40 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1673 microversion: 2.20 time: 0.248972 May 13 21:57:44.820960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 348/693] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:44 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:44.957284 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:44.965881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ef329e19-35a9-4c50-ab85-cfb6e8230c19 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.247069 May 13 21:57:44.967165 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 346/694] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:44 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:45.839504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:45.840030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:45.846306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:45.846791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:45.847552 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:45.847990 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:45.982688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:45.983895 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:45.985411 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:45.990523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:45.991032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:45.991808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:45.992250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:45.993897 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:45.995514 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:45.996758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-05783a52-2250-45f8-af15-e843334c4374 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.161232 May 13 21:57:45.997915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 349/695] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:45 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:46.199007 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:46.206245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0c977e75-accd-4fc5-a56d-9831f435d86e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.227423 May 13 21:57:46.206822 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 347/696] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:45 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:47.016579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:47.017192 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:47.026169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:47.026625 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:47.027434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:47.028956 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:47.224176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:47.225084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:47.231629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:47.232451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:47.233563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:47.234195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:47.237656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:47.247140 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:47.248658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:47.250606 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ab6eefa8-f349-49c3-a7b3-9c7748682be9 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.238473 May 13 21:57:47.251320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 350/697] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:47 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:47.399650 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:47.409862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f4350a79-d618-4f25-980a-c884c340e0da tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.190488 May 13 21:57:47.419941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 348/698] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:47 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:48.271079 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:48.272319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:48.279273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:48.280063 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:48.281346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:48.281961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:48.425761 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:48.428234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:48.428862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:48.435343 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:48.435733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:48.436427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:48.437044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:48.437883 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:48.438385 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-52d669f9-1e5e-4a22-8159-f2183469682c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.171743 May 13 21:57:48.438804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:48.439625 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 351/699] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:48 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:48.587494 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:48.594844 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bca94691-9eca-4207-b055-f51b6e215b76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.170717 May 13 21:57:48.604612 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 349/700] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:48 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:49.457034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:49.457643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:49.463849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:49.464301 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:49.465082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:49.465515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:49.615890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:49.615890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:49.624741 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:49.625662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:49.627352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:49.628898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:49.643245 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:49.667444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:49.669482 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:49.671783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-87934f2e-7805-4059-8ad5-4869fab12ca1 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.217842 May 13 21:57:49.683913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 352/701] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:49 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:49.692719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-4c63d16c-c48f-48ba-a998-7960648c62de req-2b70757a-4a71-4a1c-8029-3d0391b1d4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ae0672-baa5-43cc-afeb-8a1bb179818b", "name": "network-vif-plugged", "status": "completed", "tag": "df1579fd-2e1e-49df-91d6-e984e0f5c5ad"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:49.701470 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-4c63d16c-c48f-48ba-a998-7960648c62de req-2b70757a-4a71-4a1c-8029-3d0391b1d4fa service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:49.702304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-4c63d16c-c48f-48ba-a998-7960648c62de req-2b70757a-4a71-4a1c-8029-3d0391b1d4fa service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:49.715550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-4c63d16c-c48f-48ba-a998-7960648c62de req-2b70757a-4a71-4a1c-8029-3d0391b1d4fa service nova] Creating event network-vif-plugged:df1579fd-2e1e-49df-91d6-e984e0f5c5ad for instance c7ae0672-baa5-43cc-afeb-8a1bb179818b on hv-cinder-84051 May 13 21:57:49.723391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-4c63d16c-c48f-48ba-a998-7960648c62de req-2b70757a-4a71-4a1c-8029-3d0391b1d4fa service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037579 May 13 21:57:49.725446 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 353/702] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:49.804464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:49.819850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-30a19f1b-1dec-494c-a806-b34a4d7b287d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.211668 May 13 21:57:49.827688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 350/703] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:49 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:50.693049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:50.693833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:50.700442 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:50.700987 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:50.702435 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:50.702914 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:50.837819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:50.839524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:50.843119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:50.846368 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:50.847157 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:50.848153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:50.848975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:50.851845 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:50.853498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:50.854858 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5b326f4a-2789-4ea8-a88b-e0a0a1bdc22f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.167672 May 13 21:57:50.858771 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 354/704] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:50 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:50.989020 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:50.998414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f051c0ea-7cf7-4afc-af25-99cf4c9cb4c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.164319 May 13 21:57:50.999948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 351/705] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:50 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:51.873399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:51.874475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:51.881334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:51.881792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:51.882588 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:51.883056 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:52.016321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:52.017890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:52.024652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:52.027912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:52.031779 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:52.032582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:52.033022 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:52.037809 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:52.039691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:52.041060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-521afd43-4866-4083-ba0b-77cb1f698506 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.171614 May 13 21:57:52.052144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 355/706] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:51 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:52.177478 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:52.186161 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-401394f4-8cad-4375-bc62-9f10be3cee41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.174218 May 13 21:57:52.188271 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 352/707] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:52 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:53.059736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:53.060350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:53.066876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:53.067349 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:53.068240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:53.068711 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:53.203786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:53.204396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:53.213061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:53.213061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:53.213360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:53.213695 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:53.246073 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:53.254867 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:53.256383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:53.267746 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7fa19de2-0fd2-4084-a4d9-055e2837b7fa tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.211462 May 13 21:57:53.268368 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 356/708] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:53 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:53.367581 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:53.375047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5082bdee-8f67-4e4a-bf4b-d68498c8be6a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.175038 May 13 21:57:53.375629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 353/709] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:53 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:54.285450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:54.286199 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:54.292384 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:54.292839 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:54.293614 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:54.294048 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:54.391679 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:54.392325 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:54.399735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:54.399735 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:54.400017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:54.400357 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:54.433622 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:54.447664 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:54.449198 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:54.450363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-18d2eddb-dad9-4893-b68d-8c2aee4aa07c tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.168932 May 13 21:57:54.450953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 357/710] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:54 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:54.528447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:54.536229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-24641e3f-c529-4421-b618-6886f8212b8f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.148281 May 13 21:57:54.536830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 354/711] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:54 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:55.468957 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:55.469665 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:55.476783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:55.477366 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:55.478149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:55.478590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:55.554434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:55.554434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:55.560637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:55.561591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:55.562346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:55.562814 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:55.618645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:55.627887 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:55.628997 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:55.630869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-db89fb50-fabf-4433-b6f5-111b24d786e0 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.165735 May 13 21:57:55.636556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 358/712] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:55 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:57:55.988216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:55.995562 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7039a3e3-85ec-4039-9c85-53e50902eec3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.445560 May 13 21:57:55.996218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 355/713] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:55 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:57:56.650155 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:56.650812 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:56.657099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:56.657550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:56.658314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:56.658779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:56.787856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:56.795513 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:56.797630 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:56.798799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1373088f-fabb-41d8-ad45-3fa3e97c0967 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.152555 May 13 21:57:56.799368 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 359/714] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:56 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:57.012341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:57.012948 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:57.019215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:57.019666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:57.020430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:57.020867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:57.144980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:57.152414 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e0d8e59d-e265-4b02-aa4d-a372172c9375 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1367 microversion: 2.1 time: 0.143724 May 13 21:57:57.152936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 356/715] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:57 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:57.816801 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:57.817330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:57.823608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:57.824060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:57.824827 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:57.825264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:57.953372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:57.961577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:57.963246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:57.964425 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7ed43104-5896-4e10-be92-c5ae1e3d9448 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.151577 May 13 21:57:57.965077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 360/716] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:57 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:58.168773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:58.169384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:58.176154 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.176597 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:58.177356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.177791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:58.334032 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:58.341765 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1a10006f-c6ad-4c7c-b499-70a9f3dc99db tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1556 microversion: 2.1 time: 0.176833 May 13 21:57:58.342346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 357/717] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:57:58 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:57:58.358172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:58.358665 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:58.365163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.365629 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:58.366385 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.366842 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:58.442836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c4a3493e-f0cb-44e9-98fd-5f1077e16348 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088359 May 13 21:57:58.443454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 361/718] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 21:57:58 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:58.983052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:57:58.983737 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:57:58.989790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.990241 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:58.991035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:58.991472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:59.205003 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:59.212815 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:59.214335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:57:59.215530 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-eaf7ade1-ac2d-4464-95a1-806d75a4fcc7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.236567 May 13 21:57:59.216094 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 358/719] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:57:58 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:57:59.472159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-f18a57f2-7ab5-4bf3-8530-3389a0103916 req-735030d8-f685-4701-9ed9-b209aa8fb439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7ae0672-baa5-43cc-afeb-8a1bb179818b", "tag": "df1579fd-2e1e-49df-91d6-e984e0f5c5ad"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:59.480168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f18a57f2-7ab5-4bf3-8530-3389a0103916 req-735030d8-f685-4701-9ed9-b209aa8fb439 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:59.480682 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f18a57f2-7ab5-4bf3-8530-3389a0103916 req-735030d8-f685-4701-9ed9-b209aa8fb439 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:59.492956 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-f18a57f2-7ab5-4bf3-8530-3389a0103916 req-735030d8-f685-4701-9ed9-b209aa8fb439 service nova] Creating event network-changed:df1579fd-2e1e-49df-91d6-e984e0f5c5ad for instance c7ae0672-baa5-43cc-afeb-8a1bb179818b on hv-cinder-84051 May 13 21:57:59.498393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-f18a57f2-7ab5-4bf3-8530-3389a0103916 req-735030d8-f685-4701-9ed9-b209aa8fb439 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030338 May 13 21:57:59.500300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 362/720] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:57:59.628644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-b19afaa0-0808-4485-b1a1-51d3e7eec1ce req-06ffbf81-dee0-4bde-a1d6-fb1912f08744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "name": "network-vif-plugged", "status": "completed", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:57:59.637774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b19afaa0-0808-4485-b1a1-51d3e7eec1ce req-06ffbf81-dee0-4bde-a1d6-fb1912f08744 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:57:59.638374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b19afaa0-0808-4485-b1a1-51d3e7eec1ce req-06ffbf81-dee0-4bde-a1d6-fb1912f08744 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:57:59.652267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-b19afaa0-0808-4485-b1a1-51d3e7eec1ce req-06ffbf81-dee0-4bde-a1d6-fb1912f08744 service nova] Creating event network-vif-plugged:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:57:59.658326 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-b19afaa0-0808-4485-b1a1-51d3e7eec1ce req-06ffbf81-dee0-4bde-a1d6-fb1912f08744 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 May 13 21:57:59.659519 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 359/721] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:00.233946 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:00.235006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:00.241484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:00.241940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:00.242738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:00.243178 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:00.440363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:00.448438 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:00.449959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:00.451162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-23ad8be8-f40e-4da8-a55d-8e4e874fb242 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.221467 May 13 21:58:00.452039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 363/722] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:00 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:58:01.470568 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:01.471293 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:01.477857 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:01.478306 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:01.479096 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:01.479531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:01.607970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:01.616279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:01.617854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:01.619074 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a8d11f17-d893-432c-b4f1-0a71ac5690f7 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1731 microversion: 2.20 time: 0.152781 May 13 21:58:01.619635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 360/723] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:01 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:58:02.637478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:02.638093 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:02.644410 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:02.644869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:02.645638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:02.646085 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:02.774554 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:02.782744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:02.784253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:02.785402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b5113cf9-1e68-4ae3-a02d-c7d417a0484d tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1718 microversion: 2.20 time: 0.151875 May 13 21:58:02.785972 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 364/724] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:02 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:58:35.889245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:35.889971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:35.895668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:35.896115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:35.896868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:35.897346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:35.920643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-356a233f-8190-449c-b199-1278f612bf52 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/ips" status: 200 len: 149 microversion: 2.1 time: 0.035455 May 13 21:58:35.921245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 361/725] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:58:35 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:36.664179 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-631375485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-476909752", "security_groups": [{"name": "tempest-secgroup-smoke-1802433148"}], "block_device_mapping_v2": [{"uuid": "ccec20ad-4720-471e-a775-6a9d74d0e366", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "db469d62-9f19-4947-a3c5-257e3bf41ebd"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:36.778526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] validate_networks() for [('db469d62-9f19-4947-a3c5-257e3bf41ebd', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:58:37.174105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:58:37.174631 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:58:37.175143 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:58:37.175550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:58:37.175962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:58:37.184389 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:37.184835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:37.185638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:37.186078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:37.203398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:58:37.207254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Getting quotas for user c3a0de9ca12746be893b97d3cd11b826 and project e2695816a7fb4bd7ab0ea420b156e6e6. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:58:37.263556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:58:37.265712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccec20ad-4720-471e-a775-6a9d74d0e366',volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:58:37.271663 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb542cc1-05f1-4292-9b41-abf4812627a2"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:37.272724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:37.279578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:37.280029 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:37.280791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:37.281226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:37.391230 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-941835ab-bf06-4673-8e2f-9a61f2f06e15 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730935 May 13 21:58:37.392566 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 365/726] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:58:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:58:37.403427 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-57b33f70-e5b8-43a3-9ab2-37e595a223f1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:37.404043 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-57b33f70-e5b8-43a3-9ab2-37e595a223f1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:37.460338 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-57b33f70-e5b8-43a3-9ab2-37e595a223f1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:37.468002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-57b33f70-e5b8-43a3-9ab2-37e595a223f1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1093 microversion: 2.1 time: 0.067492 May 13 21:58:37.468002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 366/727] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:37 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:37.549712 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8b10045b-e78a-4a00-ba16-ba84ee2e6087 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281934 May 13 21:58:37.551483 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 362/728] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:58:37 2022] POST /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:38.483366 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:38.484166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:38.490487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:38.491067 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:38.491847 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:38.492291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:38.572502 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:38.581823 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-551c871c-f563-43e6-9921-88bbeca3aa95 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1199 microversion: 2.1 time: 0.102340 May 13 21:58:38.582573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 367/729] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:38 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1199 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:39.600582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:39.601275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:39.607377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:39.607830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:39.608861 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:39.609302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:39.829384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:39.837045 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-16ef2605-5b1a-4bb5-9f84-17fb2741456a tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1277 microversion: 2.1 time: 0.241171 May 13 21:58:39.838053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 363/730] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:39 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:39.977084 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-54eb57ef-00d3-4a42-adba-76a7271e513e req-8c68b391-0a89-4628-9dcd-3ab8c8f5a167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412d34a5-c099-4131-83f9-1a845f319d30", "tag": "d6036886-557c-4b1f-9914-05a443e0e1d8"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:39.985916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-54eb57ef-00d3-4a42-adba-76a7271e513e req-8c68b391-0a89-4628-9dcd-3ab8c8f5a167 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:39.986441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-54eb57ef-00d3-4a42-adba-76a7271e513e req-8c68b391-0a89-4628-9dcd-3ab8c8f5a167 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:39.997497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-54eb57ef-00d3-4a42-adba-76a7271e513e req-8c68b391-0a89-4628-9dcd-3ab8c8f5a167 service nova] Creating event network-changed:d6036886-557c-4b1f-9914-05a443e0e1d8 for instance 412d34a5-c099-4131-83f9-1a845f319d30 on hv-cinder-84051 May 13 21:58:40.002873 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-54eb57ef-00d3-4a42-adba-76a7271e513e req-8c68b391-0a89-4628-9dcd-3ab8c8f5a167 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029406 May 13 21:58:40.003770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 368/731] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:40.854751 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:40.855278 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:40.862245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:40.862686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:40.863468 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:40.863905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:41.071766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:41.079048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3ab63fb4-dee4-4b2e-bc05-0ccc61f16fdc tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1277 microversion: 2.1 time: 0.228155 May 13 21:58:41.079616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 364/732] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:40 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:41.904111 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:41.905106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:41.911109 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:41.911561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:41.912328 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:41.912762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:41.942176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4d79bf09-238c-4652-9408-8b3447532330 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042735 May 13 21:58:41.942735 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 369/733] 10.222.0.35 () {60 vars in 1342 bytes} [Fri May 13 21:58:41 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:41.997628 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:41.998130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:42.004820 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.005262 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.006014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.006442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.031816 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:58:42.095078 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:42.095813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:42.102433 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.102916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.103685 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.104122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.115709 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4fe76106-b811-42cf-8f03-a42086711d52 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 204 len: 0 microversion: 2.20 time: 0.121614 May 13 21:58:42.116299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 365/734] 10.222.0.35 () {60 vars in 1279 bytes} [Fri May 13 21:58:41 2022] DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 21:58:42.124744 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:42.126068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:42.131722 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.132174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.132937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:42.133377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:42.303548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:42.310822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ff310295-69a2-433e-b50c-7d70394d9d9b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1277 microversion: 2.1 time: 0.219671 May 13 21:58:42.311637 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 370/735] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:42 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:58:42.315578 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:42.323249 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:42.324729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:42.325863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6a1b8e13-5f2a-4212-ab91-762b7edd01cc tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.205139 May 13 21:58:42.326409 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 366/736] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:42 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:58:43.328108 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:43.329283 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:43.335534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:43.335986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:43.336749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:43.337187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:43.343786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:43.344396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:43.350742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:43.351190 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:43.351950 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:43.352381 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:43.529849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:43.537153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-aa3d57cd-261f-45c6-94a5-bdb5ef0816a9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1277 microversion: 2.1 time: 0.212862 May 13 21:58:43.537728 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 371/737] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:43 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:43.540757 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:43.548474 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:43.549969 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:43.551153 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b9b5ff99-4217-4e29-95d1-4105aac8e3cb tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1724 microversion: 2.20 time: 0.211167 May 13 21:58:43.551712 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 367/738] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:43 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 21:58:44.554229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:44.554815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:44.561377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:44.561835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:44.563678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:44.563791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:44.569200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:44.570030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:44.576404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:44.576923 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:44.577930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:44.578464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:44.685473 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:44.693953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:44.695575 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a1425d092844a2e9b8a917dc9981b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a12e6fa2119499b93806f036eb55a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:44.696835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-555e6442-88e4-4154-b4bc-c3e94067975a tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 200 len: 1656 microversion: 2.20 time: 0.131662 May 13 21:58:44.697482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 368/739] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:44 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 1656 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 21:58:44.827467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:44.835125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e17a0b7f-d825-4947-80c4-aea4bbc930e5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1277 microversion: 2.1 time: 0.284783 May 13 21:58:44.842121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 372/740] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:44 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:44.856483 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-940f3b96-977b-428f-ac24-5d17c3588260 req-30243920-dfa1-4fd3-b33d-e243f1b09691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5ebcd4-056e-424e-9d5e-6cfef76036c3", "name": "network-vif-deleted", "tag": "7fbe1808-9c98-4941-a44c-e06b5dae8e8c"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:44.866608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-940f3b96-977b-428f-ac24-5d17c3588260 req-30243920-dfa1-4fd3-b33d-e243f1b09691 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:44.867068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-940f3b96-977b-428f-ac24-5d17c3588260 req-30243920-dfa1-4fd3-b33d-e243f1b09691 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:44.879894 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-940f3b96-977b-428f-ac24-5d17c3588260 req-30243920-dfa1-4fd3-b33d-e243f1b09691 service nova] Creating event network-vif-deleted:7fbe1808-9c98-4941-a44c-e06b5dae8e8c for instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 on hv-cinder-84051 May 13 21:58:44.886543 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-940f3b96-977b-428f-ac24-5d17c3588260 req-30243920-dfa1-4fd3-b33d-e243f1b09691 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 May 13 21:58:44.887328 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 369/741] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:45.074753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1607be64-b105-4613-bd3e-0edb5ab2fc6b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: .version_select at 0x7fb7dffc70d0>, body: {"keypair": {"name": "tempest-keypair-1505914117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEmnuGJpfWllXeJD2ld1RP61k8Y8HUpt6r1dgyUajScjbyPm6kwIjvA7cAveofLsynw+sURvVmqRIr5hr7V1cUFfyIFKIIzUbv1ljwTgOKabh5mGL0o3MzZmboGvygAew=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:45.089755 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-1607be64-b105-4613-bd3e-0edb5ab2fc6b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:58:45.094028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-1607be64-b105-4613-bd3e-0edb5ab2fc6b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:58:45.124772 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1607be64-b105-4613-bd3e-0edb5ab2fc6b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053779 May 13 21:58:45.125786 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 373/742] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:58:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:45.716248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:45.716958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:45.724042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:45.725115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:45.725951 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:45.726879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:45.743171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 HTTP/1.1 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:58:45.744858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:45.746564 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'eb5ebcd4-056e-424e-9d5e-6cfef76036c3'} May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:58:45.747552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:45.749122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:45.751315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:58:45.751315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d6736480-7179-4fea-a953-70fd3e4476c3 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 404 len: 111 microversion: 2.20 time: 0.034842 May 13 21:58:45.751315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 370/743] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:45 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:58:45.756865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-39e97790-0ccb-4071-9ea8-5e239a939333 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '.version_select at 0x7fb7d77ed310>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:45.778532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-39e97790-0ccb-4071-9ea8-5e239a939333 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415147735" status: 204 len: 0 microversion: 2.20 time: 0.025213 May 13 21:58:45.779219 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 374/744] 10.222.0.35 () {60 vars in 1261 bytes} [Fri May 13 21:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415147735 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 21:58:45.859350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:45.860764 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:45.867566 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:45.868029 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:45.869387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:45.870021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:46.126891 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:46.142092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8ff3eb0f-e5fe-450b-b52b-1a4c2779e655 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.284351 May 13 21:58:46.147178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 371/745] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:45 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:46.520984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1098609481", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb86270-54c5-4ed6-9100-3db6f56fe50f"}], "security_groups": [{"name": "tempest-securitygroup--497360375"}], "key_name": "tempest-keypair-1505914117", "user_data": "}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:46.622788 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] validate_networks() for [('ffb86270-54c5-4ed6-9100-3db6f56fe50f', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:58:46.991813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:58:46.992383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:58:46.992694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:58:46.993106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:58:46.993516 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:58:47.001885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.002327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.003160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.003620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.019693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:58:47.023499 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:58:47.034462 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:58:47.036962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:58:47.081231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-cea8e93a-f4ae-44af-8c00-f4166dcfb9e2 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565136 May 13 21:58:47.081874 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 375/746] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:58:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:58:47.091489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9682e1e4-2170-4deb-9476-edf9c977138f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:47.092097 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9682e1e4-2170-4deb-9476-edf9c977138f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:47.147053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9682e1e4-2170-4deb-9476-edf9c977138f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:47.153660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9682e1e4-2170-4deb-9476-edf9c977138f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1242 microversion: 2.1 time: 0.065773 May 13 21:58:47.154164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 372/747] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:47 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:47.163302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:47.163302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:47.167538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.168064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.168898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.169342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.306749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:47.314826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-51b91e55-eb5a-42bd-b929-4f27b7c108fb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.158715 May 13 21:58:47.315574 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 376/748] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:47 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:47.592711 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:47.593198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:47.598993 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.599439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.600181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.600614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.614303 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 HTTP/1.1 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:58:47.615864 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.617485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'eb5ebcd4-056e-424e-9d5e-6cfef76036c3'} May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:58:47.621145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.622546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:47.623986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:58:47.623986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8219f4b4-30b2-489a-9e82-25f998b1b11f tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 404 len: 111 microversion: 2.20 time: 0.028385 May 13 21:58:47.623986 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 373/749] 10.222.0.35 () {60 vars in 1279 bytes} [Fri May 13 21:58:47 2022] DELETE /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:58:47.626642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:47.627333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: eb5ebcd4-056e-424e-9d5e-6cfef76036c3] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:47.633451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.633902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.634677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:47.635274 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:47.648580 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 HTTP/1.1 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:58:47.650295 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.651884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'eb5ebcd4-056e-424e-9d5e-6cfef76036c3'} May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:58:47.652811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. May 13 21:58:47.654228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:47.659265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance eb5ebcd4-056e-424e-9d5e-6cfef76036c3 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:58:47.660000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-933b91bb-3cca-46da-8be2-81fe6db7b019 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3" status: 404 len: 111 microversion: 2.20 time: 0.038153 May 13 21:58:47.660565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 377/750] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:47 2022] GET /compute/v2.1/servers/eb5ebcd4-056e-424e-9d5e-6cfef76036c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:58:48.170319 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:48.171629 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:48.178051 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.178497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.179408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.179747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.262936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:48.271747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-aced9c4a-bb1c-44e9-8722-c4f114042156 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1300 microversion: 2.1 time: 0.105571 May 13 21:58:48.272418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 374/751] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:48 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:48.332540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:48.333438 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:48.340093 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.340552 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.341321 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.341762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.542730 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:48.550557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a0bdbc1d-a24a-40df-83d2-1a311fa2f0ee tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.222751 May 13 21:58:48.551151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 378/752] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:48 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:48.796943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:48.796943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:48.806609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.806609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.806609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.806609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.822928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 HTTP/1.1 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 21:58:48.824565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.826207 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'c1cdc615-a1e5-435d-95d3-f1187a00f7e0'} May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:58:48.827168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.829125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 21:58:48.831013 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:58:48.831013 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-808f4136-83c0-438c-ac47-6c408424cb04 tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 404 len: 111 microversion: 2.20 time: 0.032818 May 13 21:58:48.831013 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 375/753] 10.222.0.35 () {60 vars in 1279 bytes} [Fri May 13 21:58:48 2022] DELETE /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:58:48.836345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:48.837400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] [instance: c1cdc615-a1e5-435d-95d3-f1187a00f7e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:48.843326 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.843784 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.845157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:48.845593 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:48.858811 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] HTTP exception thrown: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Request method failure captured: May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 HTTP/1.1 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftL5d5CiHdC5pUVnfJYY1pTm6K8IGvgd0RqMCGowBPa5nM4eZVQRrRW8mYtHIMpICfyr6OS6-nlF0f_Dnh7h3Rbtk7ACQP8Xv7hnG7-V9LC3ZAd5ty-1deviN58tnOdImhp6SOWdQfKSbPu5ZPm_X1ei1nXy8oHoL9Os0OlOi-nrmLc May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Openstack-Nova-Api-Version: 2.20 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:58:48.860280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_6a12e6fa2119499b93806f036eb55a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/6a12e6fa2119499b93806f036eb55a0c"}]}] May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 6a12e6fa2119499b93806f036eb55a0c May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-817506953 May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: 0a1425d092844a2e9b8a917dc9981b32 May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeShelveTestJSON-817506953-project May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.861806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c1cdc615-a1e5-435d-95d3-f1187a00f7e0'} May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:58:48.862578 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. May 13 21:58:48.863810 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:58:48.864855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] Returning 404 to user: Instance c1cdc615-a1e5-435d-95d3-f1187a00f7e0 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:58:48.864855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-cb64e4de-1324-4069-80ef-aac6a31101bd tempest-AttachVolumeShelveTestJSON-817506953 tempest-AttachVolumeShelveTestJSON-817506953-project] 10.222.0.35 "GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0" status: 404 len: 111 microversion: 2.20 time: 0.029264 May 13 21:58:48.864855 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 379/754] 10.222.0.35 () {60 vars in 1276 bytes} [Fri May 13 21:58:48 2022] GET /compute/v2.1/servers/c1cdc615-a1e5-435d-95d3-f1187a00f7e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 21:58:49.288374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:49.288989 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:49.295708 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:49.296162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:49.296957 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:49.298037 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:49.512634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:49.525241 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-faf68990-a417-4cc8-aed0-882080ab1f65 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.241240 May 13 21:58:49.526343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 376/755] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:49 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:49.572125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:49.572929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:49.580453 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:49.581456 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:49.582468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:49.583158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:49.791933 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-fab6ad06-6442-4504-b384-8fb08071e04a req-9b8b4f12-ff2b-49de-8cf5-01bc0ceb2419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed36eeb-83cd-4f94-898a-846513cdf2e0", "tag": "3960ab4e-793f-4cd6-bcf2-be757944ada2"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:49.810541 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-fab6ad06-6442-4504-b384-8fb08071e04a req-9b8b4f12-ff2b-49de-8cf5-01bc0ceb2419 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:49.811423 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-fab6ad06-6442-4504-b384-8fb08071e04a req-9b8b4f12-ff2b-49de-8cf5-01bc0ceb2419 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:49.826792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-fab6ad06-6442-4504-b384-8fb08071e04a req-9b8b4f12-ff2b-49de-8cf5-01bc0ceb2419 service nova] Creating event network-changed:3960ab4e-793f-4cd6-bcf2-be757944ada2 for instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 on hv-cinder-84051 May 13 21:58:49.840269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-fab6ad06-6442-4504-b384-8fb08071e04a req-9b8b4f12-ff2b-49de-8cf5-01bc0ceb2419 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050618 May 13 21:58:49.841773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 377/756] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:49.851095 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:49.859384 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f055fad3-412a-4a7c-9714-8509582726a1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.294191 May 13 21:58:49.860010 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 380/757] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:49 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:50.542951 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:50.543656 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:50.549694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:50.550142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:50.550931 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:50.551372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:50.723731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:50.730961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-28e9b8c1-69f7-45d2-bea3-d3810590d62c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.192610 May 13 21:58:50.731604 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 378/758] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:50 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:50.876026 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:50.876800 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:50.883444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:50.884016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:50.884918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:50.885458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:51.020781 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:51.030336 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-37ee8344-d6af-453a-8d60-6e8fa4e10284 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.158825 May 13 21:58:51.030985 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 381/759] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:50 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:51.753797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:51.753797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:51.765680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:51.766133 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:51.766956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:51.769610 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:51.944563 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:51.952018 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e52db5fa-3f92-4d39-96f1-8f9d0ebfe581 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.207173 May 13 21:58:51.952593 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 379/760] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:51 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:52.051111 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:52.053167 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:52.060653 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:52.061804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:52.063132 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:52.063787 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:52.236071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:52.243650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8b80253d-0287-4719-9094-1065a03550f9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.199604 May 13 21:58:52.244304 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 382/761] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:52 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:52.968764 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:52.969680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:52.976936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:52.977502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:52.978374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:52.978983 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:53.191775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:53.199560 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-924c5996-a223-4e2d-b59f-ecbb9ec2a84f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.234531 May 13 21:58:53.200141 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 380/762] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:52 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:53.260429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:53.261042 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:53.267266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:53.267726 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:53.268480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:53.268915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:53.404492 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:53.412816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7b5d39ea-9a54-4738-9919-9d3f14a610a7 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.156240 May 13 21:58:53.413386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 383/763] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:53 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:54.215952 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:54.216817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:54.224715 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:54.225659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:54.226768 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:54.227771 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:54.385746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:54.393975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d4a7dac4-e3f5-46fe-ad75-7dea7abd1a82 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.181815 May 13 21:58:54.394859 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 381/764] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:54 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:54.430602 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:54.431267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:54.437463 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:54.437918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:54.438694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:54.439163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:54.583204 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:54.591197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d2165e20-e9ac-49f6-8299-d4af30c18319 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.165654 May 13 21:58:54.602031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 384/765] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:54 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:55.411716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:55.412343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:55.418725 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:55.419189 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:55.419954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:55.420389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:55.556608 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:55.564547 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9e74c12a-4e50-4805-bafc-265403f2d117 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.156818 May 13 21:58:55.565121 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 382/766] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:55 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:55.609293 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:55.609940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:55.616249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:55.616704 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:55.617477 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:55.617921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:55.761554 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:55.770182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a0e31242-a0d5-48f9-8ffd-e44bcd0edb6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.164893 May 13 21:58:55.771206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 385/767] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:55 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:56.449198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-74bec64d-c89d-4d6d-bb18-4a0cda993329 req-702a69ad-f80b-4b8a-aa5d-7564a1f318c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412d34a5-c099-4131-83f9-1a845f319d30", "name": "network-vif-plugged", "status": "completed", "tag": "d6036886-557c-4b1f-9914-05a443e0e1d8"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:56.458679 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-74bec64d-c89d-4d6d-bb18-4a0cda993329 req-702a69ad-f80b-4b8a-aa5d-7564a1f318c2 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:56.459289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-74bec64d-c89d-4d6d-bb18-4a0cda993329 req-702a69ad-f80b-4b8a-aa5d-7564a1f318c2 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:56.472282 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-74bec64d-c89d-4d6d-bb18-4a0cda993329 req-702a69ad-f80b-4b8a-aa5d-7564a1f318c2 service nova] Creating event network-vif-plugged:d6036886-557c-4b1f-9914-05a443e0e1d8 for instance 412d34a5-c099-4131-83f9-1a845f319d30 on hv-cinder-84051 May 13 21:58:56.487769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-74bec64d-c89d-4d6d-bb18-4a0cda993329 req-702a69ad-f80b-4b8a-aa5d-7564a1f318c2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042362 May 13 21:58:56.492426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 383/768] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:56.582559 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:56.583570 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:56.591054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:56.591915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:56.595708 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:56.600940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:56.788792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:56.792959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:56.808481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:56.808481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:56.808481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:56.813783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:56.870494 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:56.885661 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-94fe5282-17c5-4795-9f6a-2841a974bd97 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.303260 May 13 21:58:56.886549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 386/769] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:56 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:57.046259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:57.055979 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a441f8d6-3602-48e4-bb78-9467c1c6dceb tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.272254 May 13 21:58:57.066092 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 384/770] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:56 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:57.902794 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:57.903515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:57.910505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:57.911253 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:57.912244 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:57.912816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:58.050781 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:58.058327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-43d6e92b-72d0-4b27-a3e4-fed0f9d6a727 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.159365 May 13 21:58:58.058930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 387/771] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:57 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:58.073171 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:58.074046 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:58.079846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:58.080292 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:58.081247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:58.081681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:58.144290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-faf83cce-f5b9-436d-a3ef-b4c9a358e7d6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: .version_select at 0x7fb7dffd20d0>, body: {"keypair": {"name": "tempest-keypair-1643847957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDf6uG4KWpn4hv3aBflBQ84Lei35gHz8bn7c8pv93629G23JuNteAWV/Vim0Su9lq+yq5KAZ/Kirw6n1cnVv/+y9LPPrPx9Gd1oNAZAtXHPWaqanFVLXVXvYll/xyGbEfQ=="}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:58.163080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-faf83cce-f5b9-436d-a3ef-b4c9a358e7d6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for project 9e5d643885114a45b305ac13bef897d3. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:58:58.167644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-faf83cce-f5b9-436d-a3ef-b4c9a358e7d6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for user dddbe23734ee4cee866d58e3314007ea and project 9e5d643885114a45b305ac13bef897d3. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:58:58.196478 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-faf83cce-f5b9-436d-a3ef-b4c9a358e7d6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178519 May 13 21:58:58.197510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 385/772] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:58:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:58:58.230983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:58.238542 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6e10cf9b-3969-4478-851d-2ee46336e29b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1265 microversion: 2.1 time: 0.168971 May 13 21:58:58.239142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 388/773] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:58 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:58.507356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-7f145a8b-2557-4223-a7b7-a474ef3bc2ce req-8e77bb8a-4826-4b1a-a839-826d4f196d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed36eeb-83cd-4f94-898a-846513cdf2e0", "name": "network-vif-plugged", "status": "completed", "tag": "3960ab4e-793f-4cd6-bcf2-be757944ada2"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:58:58.521817 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-7f145a8b-2557-4223-a7b7-a474ef3bc2ce req-8e77bb8a-4826-4b1a-a839-826d4f196d4f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:58.522484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-7f145a8b-2557-4223-a7b7-a474ef3bc2ce req-8e77bb8a-4826-4b1a-a839-826d4f196d4f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:58.551264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-7f145a8b-2557-4223-a7b7-a474ef3bc2ce req-8e77bb8a-4826-4b1a-a839-826d4f196d4f service nova] Creating event network-vif-plugged:3960ab4e-793f-4cd6-bcf2-be757944ada2 for instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 on hv-cinder-84051 May 13 21:58:58.564670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-7f145a8b-2557-4223-a7b7-a474ef3bc2ce req-8e77bb8a-4826-4b1a-a839-826d4f196d4f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061054 May 13 21:58:58.565385 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 386/774] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:58:59.077018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:59.077640 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:59.085336 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.086333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.087322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.087832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.255772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:59.256467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:59.263792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.264510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.266122 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.266786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.329260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:59.336815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1ce960bf-08ec-4562-80e4-8b85a18fb47a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1367 microversion: 2.1 time: 0.264753 May 13 21:58:59.337483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 389/775] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:59 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:59.473825 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:59.481480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9d6eb1ef-c86b-4c7b-becb-f76a1a4f623f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1452 microversion: 2.1 time: 0.230032 May 13 21:58:59.482747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 387/776] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:59 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:58:59.498739 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:58:59.499388 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:58:59.506063 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.506532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.507340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:58:59.508004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:58:59.724815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:58:59.732129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-933dd42b-4ab9-4b2c-94d2-03e0309e5061 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1452 microversion: 2.1 time: 0.237562 May 13 21:58:59.732790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 390/777] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:58:59 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:58:59.923394 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-738824112", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78fbdc0f-a69d-4b29-8570-901b523fd527"}], "security_groups": [{"name": "tempest-securitygroup--1306067314"}], "key_name": "tempest-keypair-1643847957", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:00.028908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] validate_networks() for [('78fbdc0f-a69d-4b29-8570-901b523fd527', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:59:00.354166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:00.355186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:00.367728 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.368282 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.369224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.370878 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.768089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:59:00.768598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:59:00.769150 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:59:00.769652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:59:00.770146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:59:00.785556 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.786013 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.786847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.787290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.797444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:00.809242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-eac51bb7-6d97-4b66-ab90-540281bcdcc3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1557 microversion: 2.1 time: 0.459066 May 13 21:59:00.810098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 391/778] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:00 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1557 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:00.823335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for project 9e5d643885114a45b305ac13bef897d3. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:59:00.825940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:00.826546 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:00.830101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for user dddbe23734ee4cee866d58e3314007ea and project 9e5d643885114a45b305ac13bef897d3. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:59:00.833710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.834458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.835386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:00.836051 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:00.852096 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:59:00.854671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:59:00.948762 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-14b5435b-4a2e-471d-b1c8-95bf58192032 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.030017 May 13 21:59:00.953799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 388/779] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:58:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 21:59:00.964526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-af202208-d3dc-485c-bf66-ad48abc63792 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:00.967460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-af202208-d3dc-485c-bf66-ad48abc63792 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:01.000905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-15dec8b3-aa4e-4c19-b080-11db30688c38 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179166 May 13 21:59:01.001680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 392/780] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 21:59:00 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:59:01.216717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-af202208-d3dc-485c-bf66-ad48abc63792 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:01.225511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-af202208-d3dc-485c-bf66-ad48abc63792 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1237 microversion: 2.1 time: 0.267943 May 13 21:59:01.227476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 389/781] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:00 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1237 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:01.989150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-c6e7547c-a9bd-45aa-8ecf-4700f0369d50 req-5123fbe9-829b-49d0-86ee-acf57e27c0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412d34a5-c099-4131-83f9-1a845f319d30", "tag": "d6036886-557c-4b1f-9914-05a443e0e1d8"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:01.998265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c6e7547c-a9bd-45aa-8ecf-4700f0369d50 req-5123fbe9-829b-49d0-86ee-acf57e27c0cd service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:01.999165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c6e7547c-a9bd-45aa-8ecf-4700f0369d50 req-5123fbe9-829b-49d0-86ee-acf57e27c0cd service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:02.011742 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-c6e7547c-a9bd-45aa-8ecf-4700f0369d50 req-5123fbe9-829b-49d0-86ee-acf57e27c0cd service nova] Creating event network-changed:d6036886-557c-4b1f-9914-05a443e0e1d8 for instance 412d34a5-c099-4131-83f9-1a845f319d30 on hv-cinder-84051 May 13 21:59:02.023290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-c6e7547c-a9bd-45aa-8ecf-4700f0369d50 req-5123fbe9-829b-49d0-86ee-acf57e27c0cd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139032 May 13 21:59:02.023917 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 393/782] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:02.243086 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:02.244087 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:02.252360 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:02.252822 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:02.253611 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:02.254053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:02.482462 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:02.497598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-97c06cc2-4eaa-40ae-815b-a9c7ca6af385 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1289 microversion: 2.1 time: 0.258171 May 13 21:59:02.498199 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 390/783] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:02 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1289 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:02.807420 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-5976015b-602c-48ca-b3e1-6a277da18146 req-4efefba0-febe-45f3-9f2c-f16659c5fb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed36eeb-83cd-4f94-898a-846513cdf2e0", "tag": "3960ab4e-793f-4cd6-bcf2-be757944ada2"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:02.827067 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5976015b-602c-48ca-b3e1-6a277da18146 req-4efefba0-febe-45f3-9f2c-f16659c5fb71 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:02.827526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5976015b-602c-48ca-b3e1-6a277da18146 req-4efefba0-febe-45f3-9f2c-f16659c5fb71 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:02.840353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-5976015b-602c-48ca-b3e1-6a277da18146 req-4efefba0-febe-45f3-9f2c-f16659c5fb71 service nova] Creating event network-changed:3960ab4e-793f-4cd6-bcf2-be757944ada2 for instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 on hv-cinder-84051 May 13 21:59:02.853545 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-5976015b-602c-48ca-b3e1-6a277da18146 req-4efefba0-febe-45f3-9f2c-f16659c5fb71 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048622 May 13 21:59:02.854633 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 394/784] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:03.516616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:03.517164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:03.536684 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:03.537476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:03.538528 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:03.539187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:03.683947 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:03.695040 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-58b70d5d-a888-43de-a0fc-7cbc0777d227 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1295 microversion: 2.1 time: 0.182809 May 13 21:59:03.696103 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 391/785] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:03 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:04.713992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:04.714689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:04.724368 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:04.725681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:04.726425 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:04.727025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:04.889634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-f0e3a6ab-307c-49dc-adc0-4bd762878707 req-ddcbd9c6-42df-43be-b988-52dd2b5d1e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78905677-ffd1-4408-a985-433304c4dacc", "tag": "aefeb4bf-8e41-45d1-a8ad-29d0ce76de38"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:04.899625 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f0e3a6ab-307c-49dc-adc0-4bd762878707 req-ddcbd9c6-42df-43be-b988-52dd2b5d1e0a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:04.900072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-f0e3a6ab-307c-49dc-adc0-4bd762878707 req-ddcbd9c6-42df-43be-b988-52dd2b5d1e0a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:04.918971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-f0e3a6ab-307c-49dc-adc0-4bd762878707 req-ddcbd9c6-42df-43be-b988-52dd2b5d1e0a service nova] Creating event network-changed:aefeb4bf-8e41-45d1-a8ad-29d0ce76de38 for instance 78905677-ffd1-4408-a985-433304c4dacc on hv-cinder-84051 May 13 21:59:04.924412 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-f0e3a6ab-307c-49dc-adc0-4bd762878707 req-ddcbd9c6-42df-43be-b988-52dd2b5d1e0a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038321 May 13 21:59:04.925021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 392/786] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 21:59:04.992930 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:05.005254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-db90cdff-ec25-4a63-85bd-52e00e901bc9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.295900 May 13 21:59:05.011362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 395/787] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:04 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:06.029312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:06.030044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:06.036240 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:06.036692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:06.037456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:06.037901 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:06.167095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:06.175143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-62d59faa-890e-4ce1-8e87-ff52ba96a581 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.150409 May 13 21:59:06.175722 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 393/788] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:06 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:07.192661 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:07.193270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:07.199727 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:07.200178 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:07.200954 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:07.201397 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:07.327237 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:07.334592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-80dc1e87-880a-4afb-b972-e88236be8294 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.145761 May 13 21:59:07.335272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 396/789] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:07 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:08.351356 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:08.351898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:08.358443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:08.358956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:08.359722 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:08.360156 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:08.482502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:08.489872 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-abd0b2c4-e607-4a32-b2fa-afbf7b2f2fec tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.142493 May 13 21:59:08.490456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 394/790] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:08 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:09.506423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:09.507058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:09.513331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:09.513782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:09.514541 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:09.515058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:09.642225 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:09.649372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-343e49ac-760a-44da-a705-35954bb5737c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.146789 May 13 21:59:09.649933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 397/791] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:09 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:10.252387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-d59721b1-194b-4fee-b263-25d3fccf5024 req-824eb8e8-74de-4ac0-9635-807096c62685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78905677-ffd1-4408-a985-433304c4dacc", "name": "network-vif-plugged", "status": "completed", "tag": "aefeb4bf-8e41-45d1-a8ad-29d0ce76de38"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:10.261391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-d59721b1-194b-4fee-b263-25d3fccf5024 req-824eb8e8-74de-4ac0-9635-807096c62685 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:10.261685 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-d59721b1-194b-4fee-b263-25d3fccf5024 req-824eb8e8-74de-4ac0-9635-807096c62685 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:10.272980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-d59721b1-194b-4fee-b263-25d3fccf5024 req-824eb8e8-74de-4ac0-9635-807096c62685 service nova] Creating event network-vif-plugged:aefeb4bf-8e41-45d1-a8ad-29d0ce76de38 for instance 78905677-ffd1-4408-a985-433304c4dacc on hv-cinder-84051 May 13 21:59:10.277647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-d59721b1-194b-4fee-b263-25d3fccf5024 req-824eb8e8-74de-4ac0-9635-807096c62685 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028884 May 13 21:59:10.278243 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 395/792] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:10.665356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:10.665958 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:10.673971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:10.674509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:10.675333 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:10.675768 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:10.804069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:10.811191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fe04152f-b0b0-49a9-90a5-1f947c13e782 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.149763 May 13 21:59:10.811762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 398/793] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:10 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:11.828900 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:11.829600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:11.835793 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:11.836241 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:11.837004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:11.837441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:11.962598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:11.969758 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bfadc390-e74e-4adf-b2ce-0ddf4e8439c1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1363 microversion: 2.1 time: 0.145496 May 13 21:59:11.970322 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 396/794] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:11 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:12.986824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:12.987443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:12.995582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:12.996031 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:12.996824 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:12.997264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:13.125934 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:13.133054 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0110e235-f63a-4f85-884e-1877481a8b60 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1550 microversion: 2.1 time: 0.150355 May 13 21:59:13.133619 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 399/795] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:12 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 21:59:13.149677 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:13.150189 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:13.156565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:13.157019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:13.157787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:13.158233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:13.234169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8312de7c-62ec-4b2f-a2d8-c568b417a56f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087499 May 13 21:59:13.234716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 397/796] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 21:59:13 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:14.194151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-566b9d6e-2fcb-4662-89bd-dde61222f622 req-6050af37-1e50-4d87-979c-e81197b19988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78905677-ffd1-4408-a985-433304c4dacc", "tag": "aefeb4bf-8e41-45d1-a8ad-29d0ce76de38"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:14.202854 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-566b9d6e-2fcb-4662-89bd-dde61222f622 req-6050af37-1e50-4d87-979c-e81197b19988 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:14.203302 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-566b9d6e-2fcb-4662-89bd-dde61222f622 req-6050af37-1e50-4d87-979c-e81197b19988 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:14.213561 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-566b9d6e-2fcb-4662-89bd-dde61222f622 req-6050af37-1e50-4d87-979c-e81197b19988 service nova] Creating event network-changed:aefeb4bf-8e41-45d1-a8ad-29d0ce76de38 for instance 78905677-ffd1-4408-a985-433304c4dacc on hv-cinder-84051 May 13 21:59:14.219004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-566b9d6e-2fcb-4662-89bd-dde61222f622 req-6050af37-1e50-4d87-979c-e81197b19988 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027820 May 13 21:59:14.219782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 400/797] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:37.970090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:37.970730 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:37.976480 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:37.976929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:37.977683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:37.978112 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.003384 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-eb3f90a9-9ff9-46ed-adcf-00000e9c4687 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/ips" status: 200 len: 150 microversion: 2.1 time: 0.037706 May 13 21:59:38.003953 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 398/798] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:59:37 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:38.015550 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb542cc1-05f1-4292-9b41-abf4812627a2"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:38.016689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:38.022901 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.023355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.024126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.024573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.104029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: POST /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/os-volume_attachments HTTP/1.1 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 74 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:59:38.105736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {"volumeAttachment": {"volumeId": "eb542cc1-05f1-4292-9b41-abf4812627a2"}} May 13 21:59:38.107658 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'server_id': '7ed36eeb-83cd-4f94-898a-846513cdf2e0', 'body': {'volumeAttachment': {'volumeId': 'eb542cc1-05f1-4292-9b41-abf4812627a2'}}} May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:38.109160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:38.110639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 400 to user: Invalid volume: volume eb542cc1-05f1-4292-9b41-abf4812627a2 is already attached to instances: c7ae0672-baa5-43cc-afeb-8a1bb179818b {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8a390c5f-2abe-4a6f-8dec-b4bf10c3feeb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096560 May 13 21:59:38.112324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 401/799] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:59:38 2022] POST /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 21:59:38.116678 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:38.117178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:38.123095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.124197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.124958 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.125400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.148804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:59:38.221847 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d4e8a40f-06bd-43e0-b16c-258ad8b05c64 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 204 len: 0 microversion: 2.1 time: 0.108552 May 13 21:59:38.222349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 399/800] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:59:38 2022] DELETE /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:59:38.230479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:38.231346 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:38.238796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.239246 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.240082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:38.240588 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:38.376131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:38.383416 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-67bfda8a-6a02-449c-89f3-d9642a74bd41 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1682 microversion: 2.1 time: 0.156924 May 13 21:59:38.383983 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 402/801] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:38 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:39.401151 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:39.401849 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:39.408858 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:39.409252 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:39.410015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:39.410451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:39.539503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:39.546890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3e677989-40ac-454a-9844-a03746be167e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1682 microversion: 2.1 time: 0.149937 May 13 21:59:39.547466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 400/802] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:39 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:40.564016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:40.564569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:40.571095 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:40.571544 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:40.572312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:40.572744 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:40.756668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:40.764586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-31a4cc5f-b22a-4ab4-ac77-70ae3bb54c06 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 200 len: 1682 microversion: 2.1 time: 0.203886 May 13 21:59:40.765163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 403/803] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:40 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:41.092143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-ded8ff1f-9296-4358-8e8f-db8c61733256 req-e05648b3-ca42-4998-8074-a39b40b1cfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed36eeb-83cd-4f94-898a-846513cdf2e0", "name": "network-vif-deleted", "tag": "3960ab4e-793f-4cd6-bcf2-be757944ada2"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:41.102195 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-ded8ff1f-9296-4358-8e8f-db8c61733256 req-e05648b3-ca42-4998-8074-a39b40b1cfe3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:41.102769 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-ded8ff1f-9296-4358-8e8f-db8c61733256 req-e05648b3-ca42-4998-8074-a39b40b1cfe3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:41.114985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-ded8ff1f-9296-4358-8e8f-db8c61733256 req-e05648b3-ca42-4998-8074-a39b40b1cfe3 service nova] Creating event network-vif-deleted:3960ab4e-793f-4cd6-bcf2-be757944ada2 for instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 on hv-cinder-84051 May 13 21:59:41.119891 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-ded8ff1f-9296-4358-8e8f-db8c61733256 req-e05648b3-ca42-4998-8074-a39b40b1cfe3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031447 May 13 21:59:41.120888 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 401/804] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:41.782151 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:41.782789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:41.789264 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:41.789720 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:41.790506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:41.791000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:41.804816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 HTTP/1.1 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:59:41.806360 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 21:59:41.807826 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '7ed36eeb-83cd-4f94-898a-846513cdf2e0'} May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:59:41.808639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 21:59:41.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:41.811647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:59:41.811647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-55b1cacc-8b1a-4eb6-bb9e-613c53676c5f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 404 len: 111 microversion: 2.1 time: 0.030218 May 13 21:59:41.817183 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5b8b0014-3dd1-4f21-b0aa-d1b328f483a3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '.version_select at 0x7fb7dffda940>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:41.817503 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 404/805] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:41 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:59:41.835686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5b8b0014-3dd1-4f21-b0aa-d1b328f483a3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505914117" status: 202 len: 0 microversion: 2.1 time: 0.022542 May 13 21:59:41.836265 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 402/806] 10.222.0.35 () {58 vars in 1220 bytes} [Fri May 13 21:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505914117 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:59:42.489387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:42.489878 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:42.495853 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:42.496336 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:42.497109 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:42.497564 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:42.573575 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lazy-loading 'services' on Instance uuid c7ae0672-baa5-43cc-afeb-8a1bb179818b {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 21:59:42.642101 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-aa69f39d-44e6-4798-8d55-456d6574b274 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments/eb542cc1-05f1-4292-9b41-abf4812627a2" status: 202 len: 0 microversion: 2.1 time: 0.156376 May 13 21:59:42.642740 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 405/807] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 21:59:42 2022] DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments/eb542cc1-05f1-4292-9b41-abf4812627a2 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 21:59:42.651002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:42.652053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:42.659211 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:42.659671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:42.660461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:42.660902 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:42.690951 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c4c4382c-3c3f-4f95-a6b3-79f841204180 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 May 13 21:59:42.691510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 403/808] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:59:42 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:43.703213 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:43.704272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:43.710473 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.710961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:43.711758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.712191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:43.741145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4b5893c8-033e-4641-91ad-7ef2cdbaf2a0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043248 May 13 21:59:43.741708 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 406/809] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 21:59:43 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 21:59:43.799594 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:43.800085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:43.806162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.806605 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:43.807387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.807819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:43.832462 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 21:59:43.905648 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6afefac1-1948-482b-8074-3a3ff186dab3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 204 len: 0 microversion: 2.1 time: 0.109224 May 13 21:59:43.906575 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 404/810] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 21:59:43 2022] DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 21:59:43.914989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:43.915600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:43.921534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.921989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:43.922781 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:43.923224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:44.062138 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:44.069353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-653ed7dc-0d10-4326-a445-f1309c1d3390 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1681 microversion: 2.1 time: 0.158161 May 13 21:59:44.069914 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 407/811] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:43 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:45.085837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:45.086531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:45.093481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:45.093932 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:45.094825 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:45.095339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:45.227929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:45.236105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0a453e3b-116f-4696-9445-0e209fdc0263 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1681 microversion: 2.1 time: 0.153905 May 13 21:59:45.236695 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 405/812] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:45 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:46.252553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:46.253393 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:46.260055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:46.260737 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:46.261275 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:46.261775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:46.334300 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:46.343540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ef31754e-ad24-4fa6-96d4-ca6c088bc6c0 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 200 len: 1613 microversion: 2.1 time: 0.094677 May 13 21:59:46.344322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 408/813] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:46 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:46.563004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-dab52fd0-412f-422c-ac26-e97daa374bac req-fe84d8f8-2633-418f-b261-a2d29024376a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7ae0672-baa5-43cc-afeb-8a1bb179818b", "name": "network-vif-deleted", "tag": "df1579fd-2e1e-49df-91d6-e984e0f5c5ad"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:46.572061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-dab52fd0-412f-422c-ac26-e97daa374bac req-fe84d8f8-2633-418f-b261-a2d29024376a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:46.572508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-dab52fd0-412f-422c-ac26-e97daa374bac req-fe84d8f8-2633-418f-b261-a2d29024376a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:46.584062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-dab52fd0-412f-422c-ac26-e97daa374bac req-fe84d8f8-2633-418f-b261-a2d29024376a service nova] Creating event network-vif-deleted:df1579fd-2e1e-49df-91d6-e984e0f5c5ad for instance c7ae0672-baa5-43cc-afeb-8a1bb179818b on hv-cinder-84051 May 13 21:59:46.588965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-dab52fd0-412f-422c-ac26-e97daa374bac req-fe84d8f8-2633-418f-b261-a2d29024376a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030080 May 13 21:59:46.590140 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 406/814] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:47.362398 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:47.363098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:47.369410 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:47.369890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:47.370644 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:47.371112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:47.387527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b HTTP/1.1 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 21:59:47.389259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 21:59:47.390886 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c7ae0672-baa5-43cc-afeb-8a1bb179818b'} May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 21:59:47.391848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 21:59:47.393099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 21:59:47.394170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 21:59:47.394170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-52206527-8fad-4e0c-b0ed-8e3643a43c5d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 404 len: 111 microversion: 2.1 time: 0.032781 May 13 21:59:47.394170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 409/815] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:47 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 21:59:47.400234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d87d0d98-434d-4a7b-ac7b-cb94f4d11900 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '.version_select at 0x7fb7d66211f0>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:47.419268 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d87d0d98-434d-4a7b-ac7b-cb94f4d11900 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354241518" status: 202 len: 0 microversion: 2.1 time: 0.023225 May 13 21:59:47.419866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 407/816] 10.222.0.35 () {58 vars in 1220 bytes} [Fri May 13 21:59:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354241518 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 21:59:48.032024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d9885e44-4f2b-4ad2-8998-ed42d09d2fa5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: .version_select at 0x7fb7dff86b80>, body: {"keypair": {"name": "tempest-keypair-1544236913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2byoacjcsdmxSi5ekJsTyKP30Uj2NgfMSE1MWmIlv3lM7CY31YM5dOGtcXOtnPE14a+RoiO75t5dtFfxHRLbPpMyVSNxR1gRxgMtF/RfUmt3htqvUTB49AH3NYDDQzCQ=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:48.045413 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-d9885e44-4f2b-4ad2-8998-ed42d09d2fa5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:59:48.049118 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-d9885e44-4f2b-4ad2-8998-ed42d09d2fa5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:59:48.070196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d9885e44-4f2b-4ad2-8998-ed42d09d2fa5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042646 May 13 21:59:48.070875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 410/817] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 21:59:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:49.567056 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-867324979", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb86270-54c5-4ed6-9100-3db6f56fe50f"}], "security_groups": [{"name": "tempest-securitygroup--1669840072"}], "key_name": "tempest-keypair-1544236913", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:49.667624 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] validate_networks() for [('ffb86270-54c5-4ed6-9100-3db6f56fe50f', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 21:59:50.039756 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 21:59:50.040178 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 21:59:50.040647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 21:59:50.041051 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 21:59:50.041455 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 21:59:50.050269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:50.050732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:50.051516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:50.051972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:50.068136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 21:59:50.071897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 21:59:50.082645 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 21:59:50.084955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 21:59:50.130372 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8efc1937-e66b-44b9-8529-879fb31f9723 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567555 May 13 21:59:50.131043 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 408/818] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 21:59:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 21:59:50.140923 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c4dc5bd7-4503-49bc-a695-24f3a1ac1d90 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:50.141536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c4dc5bd7-4503-49bc-a695-24f3a1ac1d90 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:50.194451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c4dc5bd7-4503-49bc-a695-24f3a1ac1d90 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:50.201841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c4dc5bd7-4503-49bc-a695-24f3a1ac1d90 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1241 microversion: 2.1 time: 0.064789 May 13 21:59:50.202401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 411/819] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:50 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:50.419254 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:50.419819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:50.428870 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:50.428870 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:50.429419 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:50.429917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:50.458528 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6774e98e-8cd6-4671-a2d4-cf87f2f3e25c tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/ips" status: 200 len: 146 microversion: 2.1 time: 0.043042 May 13 21:59:50.464452 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 409/820] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 21:59:50 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:51.219162 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:51.219890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:51.226163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:51.226609 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:51.227622 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:51.228065 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:51.291904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:51.299710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8b22f835-4a97-471f-ba4c-9ca57c36fd7b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1301 microversion: 2.1 time: 0.084831 May 13 21:59:51.300377 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 412/821] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:51 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:52.317166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:52.317781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:52.324390 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:52.324908 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:52.325752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:52.326271 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:52.546211 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:52.554786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3aafb225-3b36-4992-9933-b9b3357ee587 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.241323 May 13 21:59:52.555546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 410/822] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:52 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:53.078231 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-7965b42a-112a-488d-b5f8-eebf93d64404 req-a04625b0-6f76-429d-95e7-861e5dacff26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509162fe-11c2-46c2-bcb9-806b229cfcfe", "tag": "b92d864c-4291-4c00-b9d1-a641e24a3814"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:53.088223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-7965b42a-112a-488d-b5f8-eebf93d64404 req-a04625b0-6f76-429d-95e7-861e5dacff26 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:53.089055 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-7965b42a-112a-488d-b5f8-eebf93d64404 req-a04625b0-6f76-429d-95e7-861e5dacff26 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:53.106974 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-7965b42a-112a-488d-b5f8-eebf93d64404 req-a04625b0-6f76-429d-95e7-861e5dacff26 service nova] Creating event network-changed:b92d864c-4291-4c00-b9d1-a641e24a3814 for instance 509162fe-11c2-46c2-bcb9-806b229cfcfe on hv-cinder-84051 May 13 21:59:53.113833 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-7965b42a-112a-488d-b5f8-eebf93d64404 req-a04625b0-6f76-429d-95e7-861e5dacff26 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040437 May 13 21:59:53.117538 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 413/823] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:53.572194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:53.572807 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:53.580637 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:53.581167 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:53.581950 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:53.582387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:53.711352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:53.722882 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-65ee514c-e3ea-4d3b-a6b3-aeef500f6ef7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.154289 May 13 21:59:53.723469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 411/824] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:53 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:53.749126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9059d2dc-c7b3-452c-abdd-eb1a39c2aed2"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:53.751259 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:53.757707 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:53.758158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:53.758952 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:53.759412 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:54.661267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-43ed3ae0-116e-440c-8b75-f38658e79e66 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916107 May 13 21:59:54.661939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 414/825] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 21:59:53 2022] POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:54.740573 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:54.741355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:54.748280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:54.748820 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:54.750255 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:54.750791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:55.126354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:55.133513 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-244fcc76-9126-48a9-bc76-5bcea99eea4b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.397909 May 13 21:59:55.134266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 412/826] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:54 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:56.151313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:56.151937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:56.158095 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:56.158536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:56.159320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:56.159752 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:56.285260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:56.292372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4b28e6fb-3af8-4cd8-b25d-1cd79f5d67eb tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.145836 May 13 21:59:56.292945 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 415/827] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:56 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:57.308921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:57.309553 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:57.316353 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:57.316796 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:57.317546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:57.317974 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:57.449230 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:57.456348 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-73571c40-080d-45a3-828a-3defb357cdca tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.151267 May 13 21:59:57.456940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 413/828] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:57 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:58.473573 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:58.474228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:58.480441 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:58.480894 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:58.481691 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:58.482390 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:58.564376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-38b8c9a0-7846-45b1-8d82-70d0809d1767 req-178eb34e-e4a6-4cdd-95ac-f38558b566c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509162fe-11c2-46c2-bcb9-806b229cfcfe", "name": "network-vif-plugged", "status": "completed", "tag": "b92d864c-4291-4c00-b9d1-a641e24a3814"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 21:59:58.585000 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-38b8c9a0-7846-45b1-8d82-70d0809d1767 req-178eb34e-e4a6-4cdd-95ac-f38558b566c0 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:58.585436 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-38b8c9a0-7846-45b1-8d82-70d0809d1767 req-178eb34e-e4a6-4cdd-95ac-f38558b566c0 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:58.596917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-38b8c9a0-7846-45b1-8d82-70d0809d1767 req-178eb34e-e4a6-4cdd-95ac-f38558b566c0 service nova] Creating event network-vif-plugged:b92d864c-4291-4c00-b9d1-a641e24a3814 for instance 509162fe-11c2-46c2-bcb9-806b229cfcfe on hv-cinder-84051 May 13 21:59:58.601916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-38b8c9a0-7846-45b1-8d82-70d0809d1767 req-178eb34e-e4a6-4cdd-95ac-f38558b566c0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043332 May 13 21:59:58.602826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 414/829] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 21:59:58.617182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:58.625000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3266a4df-bc3c-4b83-987d-285460a1c48b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.155372 May 13 21:59:58.625572 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 416/830] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:58 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 21:59:59.642626 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 21:59:59.643352 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 21:59:59.649448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:59.649895 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:59.650649 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 21:59:59.651117 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 21:59:59.781693 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 21:59:59.790343 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5ee7eccc-5c55-461e-8893-84710563bbc7 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1367 microversion: 2.1 time: 0.152063 May 13 21:59:59.791082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 415/831] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 21:59:59 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:00.807157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:00.807758 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:00.814027 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:00.814477 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:00.815266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:00.815705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:00.950037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:00.957283 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a5833013-5c9e-4ed3-a54c-d6e52bf406de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1556 microversion: 2.1 time: 0.153902 May 13 22:00:00.957854 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 417/832] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:00 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:00.973540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:00.974128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:00.980651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:00.981079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:00.982119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:00.982572 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:01.062052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b88d360b-f6d4-4d1f-a1ef-ee7e2858c568 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092281 May 13 22:00:01.062837 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 416/833] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 22:00:00 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:02.028061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-14087627-e356-4e5c-b92f-fdd65e9f59f5 req-513d89bf-d2d0-4edb-8ba2-eabcb175bea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509162fe-11c2-46c2-bcb9-806b229cfcfe", "tag": "b92d864c-4291-4c00-b9d1-a641e24a3814"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:02.037271 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-14087627-e356-4e5c-b92f-fdd65e9f59f5 req-513d89bf-d2d0-4edb-8ba2-eabcb175bea7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:02.037730 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-14087627-e356-4e5c-b92f-fdd65e9f59f5 req-513d89bf-d2d0-4edb-8ba2-eabcb175bea7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:02.048453 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-14087627-e356-4e5c-b92f-fdd65e9f59f5 req-513d89bf-d2d0-4edb-8ba2-eabcb175bea7 service nova] Creating event network-changed:b92d864c-4291-4c00-b9d1-a641e24a3814 for instance 509162fe-11c2-46c2-bcb9-806b229cfcfe on hv-cinder-84051 May 13 22:00:02.053537 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-14087627-e356-4e5c-b92f-fdd65e9f59f5 req-513d89bf-d2d0-4edb-8ba2-eabcb175bea7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029010 May 13 22:00:02.054206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 418/834] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:02.141194 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8b08cd6d-1c65-470a-a3ff-d0947af94124 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:02.147682 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b08cd6d-1c65-470a-a3ff-d0947af94124 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:02.148168 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8b08cd6d-1c65-470a-a3ff-d0947af94124 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:02.208887 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8b08cd6d-1c65-470a-a3ff-d0947af94124 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Going to try to stop instance {{(pid=128488) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 22:00:02.255476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8b08cd6d-1c65-470a-a3ff-d0947af94124 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action" status: 202 len: 0 microversion: 2.1 time: 0.118966 May 13 22:00:02.258995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 417/835] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:00:02 2022] POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:02.265452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:02.266165 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:02.273610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:02.274074 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:02.274932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:02.275355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:02.456804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:02.464623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-553a5561-8fd7-4332-a7eb-f3143500cf96 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.204030 May 13 22:00:02.465281 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 419/836] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:02 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:00:03.482546 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:03.483290 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:03.489412 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:03.489867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:03.490653 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:03.491100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:03.621638 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:03.629929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-84c4edf7-5aa4-49a9-8464-1e753fecca00 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.152325 May 13 22:00:03.630489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 418/837] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:03 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:04.646898 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:04.647506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:04.653760 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:04.654206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:04.654987 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:04.655960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:04.780468 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:04.788257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b36e5829-eecc-4095-a038-4755896027cc tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.145196 May 13 22:00:04.788820 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 420/838] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:04 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:05.804341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:05.804990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:05.811475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:05.812090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:05.812944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:05.813382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:05.951281 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:05.959461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cc5a6370-7f6f-420f-ab89-256d5351c4da tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.158957 May 13 22:00:05.960035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 419/839] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:05 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:06.976927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:06.977536 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:06.984723 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:06.985176 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:06.985937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:06.986375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:07.115643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:07.123576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d2f8226c-99f5-411f-9177-395fc5fcffd0 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.150470 May 13 22:00:07.124266 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 421/840] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:06 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:08.140114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:08.140740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:08.150308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:08.150781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:08.151558 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:08.151995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:08.281935 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:08.289642 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d22472ca-7406-4081-ac68-ecd2d7b0bef2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.153280 May 13 22:00:08.290144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 420/841] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:08 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:09.306892 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:09.307501 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:09.314454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:09.314937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:09.315707 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:09.316145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:09.444447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:09.452090 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b9ed881d-6efd-4533-b873-726fd42ce059 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.149061 May 13 22:00:09.452659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 422/842] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:09 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:10.468954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:10.469551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:10.475938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:10.476387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:10.477137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:10.477568 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:10.602439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:10.611062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3025979b-f012-416c-b91d-3db7d9458128 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.145888 May 13 22:00:10.611633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 421/843] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:10 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:11.627586 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:11.628184 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:11.634451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:11.634929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:11.635715 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:11.636147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:11.761426 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:11.769612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bd1577a1-9fa8-4362-9511-192f18bad900 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1724 microversion: 2.1 time: 0.145839 May 13 22:00:11.770158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 423/844] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:11 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:12.787042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:12.787651 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:12.793866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:12.794317 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:12.795109 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:12.795552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:12.922896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:12.930668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c557671a-c822-4257-9584-93fb10113c99 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1701 microversion: 2.1 time: 0.147572 May 13 22:00:12.931259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 422/845] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:12 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1701 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:12.946648 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bb21ef1a-d353-4fd4-8071-c2d1aeaf0636 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:12.952909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb21ef1a-d353-4fd4-8071-c2d1aeaf0636 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:12.953359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bb21ef1a-d353-4fd4-8071-c2d1aeaf0636 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:13.012741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bb21ef1a-d353-4fd4-8071-c2d1aeaf0636 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Going to try to start instance {{(pid=128489) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 22:00:13.053211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bb21ef1a-d353-4fd4-8071-c2d1aeaf0636 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action" status: 202 len: 0 microversion: 2.1 time: 0.110161 May 13 22:00:13.053803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 424/846] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:00:12 2022] POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:13.061787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:13.062417 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:13.068401 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:13.068854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:13.069702 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:13.070148 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:13.207197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:13.215001 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c5d69b47-2887-43bd-a0e0-15586e05a97d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1710 microversion: 2.1 time: 0.157017 May 13 22:00:13.215794 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 423/847] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:13 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:14.234558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:14.235269 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:14.241434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:14.241885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:14.242648 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:14.243117 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:14.370642 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:14.380541 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d548aac8-b4a2-40ec-9a77-c3ec93f7ba78 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1710 microversion: 2.1 time: 0.151382 May 13 22:00:14.381113 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 425/848] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:14 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:15.397125 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:15.397660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:15.404049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:15.404501 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:15.405269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:15.405717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:15.532870 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:15.540599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-969e332b-fe11-4ecc-8014-774d711aee1b tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1714 microversion: 2.1 time: 0.147432 May 13 22:00:15.541158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 424/849] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:15 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:36.591783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:36.592316 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:36.593579 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-c9855e75-4a80-43c3-8261-964eac82229d req-a9783159-3a71-4e52-8dad-1f545aac5237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412d34a5-c099-4131-83f9-1a845f319d30", "tag": "d6036886-557c-4b1f-9914-05a443e0e1d8"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:36.599207 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:36.599729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:36.600565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:36.601213 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:36.602523 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-c9855e75-4a80-43c3-8261-964eac82229d req-a9783159-3a71-4e52-8dad-1f545aac5237 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:36.603216 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-c9855e75-4a80-43c3-8261-964eac82229d req-a9783159-3a71-4e52-8dad-1f545aac5237 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:36.615149 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-c9855e75-4a80-43c3-8261-964eac82229d req-a9783159-3a71-4e52-8dad-1f545aac5237 service nova] Creating event network-changed:d6036886-557c-4b1f-9914-05a443e0e1d8 for instance 412d34a5-c099-4131-83f9-1a845f319d30 on hv-cinder-84051 May 13 22:00:36.620652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-c9855e75-4a80-43c3-8261-964eac82229d req-a9783159-3a71-4e52-8dad-1f545aac5237 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030553 May 13 22:00:36.621795 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 425/850] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:00:36.627235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:00:36.707647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-588e37af-9b3b-4215-ace1-a816fcec7df1 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "DELETE /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 204 len: 0 microversion: 2.1 time: 0.119642 May 13 22:00:36.711693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 426/851] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:00:36 2022] DELETE /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:00:36.717297 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:36.718008 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:36.729354 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:36.729822 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:36.730630 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:36.731100 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:36.874811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:36.882215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c7a2f8fd-7481-4bed-b0c1-c1cbb91a05d5 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1577 microversion: 2.1 time: 0.169128 May 13 22:00:36.883015 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 426/852] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:36 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:37.901929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:37.902540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:37.909480 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:37.909941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:37.910792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:37.911240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:38.072481 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:38.073079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:38.079233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:38.079704 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:38.080461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:38.080899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:38.086450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:38.093711 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1edd081c-c8e0-4da6-859e-5f968f843315 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1577 microversion: 2.1 time: 0.196014 May 13 22:00:38.094283 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 427/853] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:37 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:38.104119 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e8a7d8d5-264d-4412-a692-1001dab8a8ec tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/ips" status: 200 len: 148 microversion: 2.1 time: 0.035460 May 13 22:00:38.104686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 427/854] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 22:00:38 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:00:39.061748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-fc86b797-c09b-44a1-b52f-73ddebf477c7 req-1d1951a5-bbba-4bd3-b628-23f9ffc7966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412d34a5-c099-4131-83f9-1a845f319d30", "name": "network-vif-deleted", "tag": "d6036886-557c-4b1f-9914-05a443e0e1d8"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:39.072806 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-fc86b797-c09b-44a1-b52f-73ddebf477c7 req-1d1951a5-bbba-4bd3-b628-23f9ffc7966d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:39.073464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-fc86b797-c09b-44a1-b52f-73ddebf477c7 req-1d1951a5-bbba-4bd3-b628-23f9ffc7966d service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:39.086722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-fc86b797-c09b-44a1-b52f-73ddebf477c7 req-1d1951a5-bbba-4bd3-b628-23f9ffc7966d service nova] Creating event network-vif-deleted:d6036886-557c-4b1f-9914-05a443e0e1d8 for instance 412d34a5-c099-4131-83f9-1a845f319d30 on hv-cinder-84051 May 13 22:00:39.091598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-fc86b797-c09b-44a1-b52f-73ddebf477c7 req-1d1951a5-bbba-4bd3-b628-23f9ffc7966d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 May 13 22:00:39.092239 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 428/855] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:39.111897 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:39.112974 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:39.119820 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:39.120275 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:39.121050 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:39.121490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:39.183060 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:39.191261 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-49442d01-39f6-4a35-88ac-b54f94bbbf6b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1224 microversion: 2.1 time: 0.083595 May 13 22:00:39.191915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 428/856] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:39 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:39.421918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2370789-c9a5-4c5f-8fc1-fd2de3a00b72"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:39.423115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:39.435598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:39.436071 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:39.436913 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:39.437962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:39.693248 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-699f03e6-85c3-4c64-920e-dec025b10b61 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275793 May 13 22:00:39.693858 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 429/857] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:00:39 2022] POST /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:40.208079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:40.208997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:40.218047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:40.218497 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:40.219697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:40.220136 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:40.251511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:40.252548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:40.253002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lazy-loading 'fault' on Instance uuid 412d34a5-c099-4131-83f9-1a845f319d30 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:00:40.293477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:40.300146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-533c94c9-a225-4f13-81cf-4443cadb2813 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 200 len: 1183 microversion: 2.1 time: 0.096447 May 13 22:00:40.300684 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 429/858] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:40 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 1183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:41.319243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:41.319936 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 412d34a5-c099-4131-83f9-1a845f319d30] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:41.326104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:41.326557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:41.327355 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:41.327797 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:41.340533 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] HTTP exception thrown: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Request method failure captured: May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 HTTP/1.1 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvoIodZq9E2xTTEf2HJazrVhJHJbUtRtbKNuFeeVI_EyleLglnyMnvk_KTuKqtm7fWKSgxnUZGGAmDKN12Cg05BOy1DJIpvd6NSX1VnKlTdXFkpe_B_wAoqqrq15Gjn_BXQcDhONAK5B5bwyxRZorGkywjupi0GnlsHQ5LqqA7jKg May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:00:41.342112 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2695816a7fb4bd7ab0ea420b156e6e6"}]}] May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-TestVolumeBootPattern-572711134 May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: c3a0de9ca12746be893b97d3cd11b826 May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. May 13 22:00:41.343779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '412d34a5-c099-4131-83f9-1a845f319d30'} May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:41.344656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. May 13 22:00:41.345961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:41.347169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Returning 404 to user: Instance 412d34a5-c099-4131-83f9-1a845f319d30 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:41.347169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8788afb3-235a-41f1-a660-fb8c306928f2 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30" status: 404 len: 111 microversion: 2.1 time: 0.029474 May 13 22:00:41.347169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 430/859] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:41 2022] GET /compute/v2.1/servers/412d34a5-c099-4131-83f9-1a845f319d30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:00:44.436920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:44.437975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:44.440735 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-d7a868a4-8240-4bd5-84f4-259a66b606f1 req-084c88f9-494a-4a71-9f92-c939d3bf3f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b508c5-7d8a-4a7f-8732-c1b6d75f010c", "tag": "ae3ce264-7948-4690-9c35-37b75db494f0"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:44.450270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d7a868a4-8240-4bd5-84f4-259a66b606f1 req-084c88f9-494a-4a71-9f92-c939d3bf3f29 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:44.450644 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:44.450922 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-d7a868a4-8240-4bd5-84f4-259a66b606f1 req-084c88f9-494a-4a71-9f92-c939d3bf3f29 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:44.451121 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:44.451922 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:44.452565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:44.465076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-d7a868a4-8240-4bd5-84f4-259a66b606f1 req-084c88f9-494a-4a71-9f92-c939d3bf3f29 service nova] Creating event network-changed:ae3ce264-7948-4690-9c35-37b75db494f0 for instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c on hv-cinder-84051 May 13 22:00:44.470929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-d7a868a4-8240-4bd5-84f4-259a66b606f1 req-084c88f9-494a-4a71-9f92-c939d3bf3f29 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035048 May 13 22:00:44.472006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 431/860] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:44.479997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:00:44.559898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0b36ebef-9b26-4b17-b258-5cd77802131f tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "DELETE /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 204 len: 0 microversion: 2.1 time: 0.126415 May 13 22:00:44.564729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 430/861] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:00:44 2022] DELETE /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:00:44.571254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:44.572340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:44.578531 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:44.579024 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:44.579801 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:44.580245 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:44.720491 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:44.728982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ad6c6433-3dd7-4e3c-b0ba-6cfac2768b11 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1576 microversion: 2.1 time: 0.161976 May 13 22:00:44.729567 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 432/862] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:44 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:45.747753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:45.748454 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:45.755706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:45.756162 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:45.756934 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:45.757376 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:45.955002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:45.962671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-016ccc60-ff41-4a58-b9f0-8a952e30ba74 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1576 microversion: 2.1 time: 0.219238 May 13 22:00:45.963262 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 431/863] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:45 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:46.979444 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:46.980082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:46.986502 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:46.987039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:46.987800 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:46.988233 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.175852 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2370789-c9a5-4c5f-8fc1-fd2de3a00b72"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:47.176963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:47.182726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.183172 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.183925 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.184367 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.237980 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:47.245553 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-37e021b6-779c-487f-b3d5-d82b453d0af9 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1576 microversion: 2.1 time: 0.269993 May 13 22:00:47.246119 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 433/864] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:46 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:47.270957 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: POST /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments HTTP/1.1 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 74 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:00:47.273010 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {"volumeAttachment": {"volumeId": "a2370789-c9a5-4c5f-8fc1-fd2de3a00b72"}} May 13 22:00:47.274742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'server_id': '509162fe-11c2-46c2-bcb9-806b229cfcfe', 'body': {'volumeAttachment': {'volumeId': 'a2370789-c9a5-4c5f-8fc1-fd2de3a00b72'}}} May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:47.275676 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:47.277142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 400 to user: Invalid volume: volume a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 is already attached to instances: 509162fe-11c2-46c2-bcb9-806b229cfcfe {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-fc839914-0b1d-4030-9184-d013478873fe tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102879 May 13 22:00:47.278571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 432/865] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:00:47 2022] POST /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 22:00:47.338754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:47.339251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:47.345248 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.345940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.346766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.347211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.429506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lazy-loading 'services' on Instance uuid 509162fe-11c2-46c2-bcb9-806b229cfcfe {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:00:47.441309 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-6f812834-065d-49a1-91b3-23bd4200c2e4 req-d4c83628-f1ec-4f92-a2df-8f6742802cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b508c5-7d8a-4a7f-8732-c1b6d75f010c", "name": "network-vif-deleted", "tag": "ae3ce264-7948-4690-9c35-37b75db494f0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:47.454767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-6f812834-065d-49a1-91b3-23bd4200c2e4 req-d4c83628-f1ec-4f92-a2df-8f6742802cc4 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.455286 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-6f812834-065d-49a1-91b3-23bd4200c2e4 req-d4c83628-f1ec-4f92-a2df-8f6742802cc4 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.468229 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-6f812834-065d-49a1-91b3-23bd4200c2e4 req-d4c83628-f1ec-4f92-a2df-8f6742802cc4 service nova] Creating event network-vif-deleted:ae3ce264-7948-4690-9c35-37b75db494f0 for instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c on hv-cinder-84051 May 13 22:00:47.473304 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-6f812834-065d-49a1-91b3-23bd4200c2e4 req-d4c83628-f1ec-4f92-a2df-8f6742802cc4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 May 13 22:00:47.473905 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 433/866] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:00:47.506727 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6a3b75d5-46c0-493d-86a4-43ab249784de tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments/a2370789-c9a5-4c5f-8fc1-fd2de3a00b72" status: 202 len: 0 microversion: 2.1 time: 0.172051 May 13 22:00:47.507347 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 434/867] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:00:47 2022] DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments/a2370789-c9a5-4c5f-8fc1-fd2de3a00b72 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:47.516661 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:47.518133 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:47.525556 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.526535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.528251 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:47.528832 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:47.558393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1f0278c8-3575-419e-97ef-d540054fc711 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 May 13 22:00:47.558977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 434/868] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:00:47 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:48.264169 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:48.264865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:48.270937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.271392 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.272155 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.272707 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.303125 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.303585 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.304060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lazy-loading 'fault' on Instance uuid 48b508c5-7d8a-4a7f-8732-c1b6d75f010c {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:00:48.350805 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0de9ca12746be893b97d3cd11b826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2695816a7fb4bd7ab0ea420b156e6e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:48.358432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2efa3819-30e4-4de3-8b90-1ad2a9b0541b tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 200 len: 1229 microversion: 2.1 time: 0.098828 May 13 22:00:48.359099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 435/869] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:48 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:48.570929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:48.571855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:48.578036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.578484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.579270 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.579706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.608733 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-231ffd55-1c18-4134-83fd-a4f668a25056 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041700 May 13 22:00:48.609285 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 435/870] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:00:48 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 22:00:48.664698 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:48.665116 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:48.671703 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.672166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.672995 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.673429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.678311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:48.678965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:48.684934 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.685388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.686155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.686591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.700599 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:00:48.774442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lazy-loading 'services' on Instance uuid 78905677-ffd1-4408-a985-433304c4dacc {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:00:48.775245 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8e9a2e20-7c9c-44ad-a3df-a125c67fb35b tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 204 len: 0 microversion: 2.1 time: 0.114202 May 13 22:00:48.776017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 436/871] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:00:48 2022] DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:00:48.784961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:48.785652 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:48.791680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.792131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.792935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:48.793375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:48.851265 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8e30211a-33e8-4731-8321-679ec8305420 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments/9059d2dc-c7b3-452c-abdd-eb1a39c2aed2" status: 202 len: 0 microversion: 2.1 time: 0.177295 May 13 22:00:48.851862 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 436/872] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:00:48 2022] DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments/9059d2dc-c7b3-452c-abdd-eb1a39c2aed2 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 22:00:48.925955 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:48.933380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-04709823-eb8d-4f2f-887f-391a2055e692 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1680 microversion: 2.1 time: 0.152596 May 13 22:00:48.933935 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 437/873] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:48 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:00:49.376378 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:49.377111 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 48b508c5-7d8a-4a7f-8732-c1b6d75f010c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:49.383274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.383747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.384515 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.384949 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.397655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] HTTP exception thrown: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Request method failure captured: May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c HTTP/1.1 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftMvoIodZq9E2xTTEf2HJazrVhJHJbUtRtbKNuFeeVI_EyleLglnyMnvk_KTuKqtm7fWKSgxnUZGGAmDKN12Cg05BOy1DJIpvd6NSX1VnKlTdXFkpe_B_wAoqqrq15Gjn_BXQcDhONAK5B5bwyxRZorGkywjupi0GnlsHQ5LqqA7jKg May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:00:49.399398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2695816a7fb4bd7ab0ea420b156e6e6"}]}] May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: c3a0de9ca12746be893b97d3cd11b826 May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. May 13 22:00:49.400954 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '48b508c5-7d8a-4a7f-8732-c1b6d75f010c'} May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:49.401777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. May 13 22:00:49.403184 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.404311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Returning 404 to user: Instance 48b508c5-7d8a-4a7f-8732-c1b6d75f010c could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:49.404311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-690ad455-e347-4eb9-8254-c72f64cb6bf3 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c" status: 404 len: 111 microversion: 2.1 time: 0.028588 May 13 22:00:49.404311 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 437/874] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:49 2022] GET /compute/v2.1/servers/48b508c5-7d8a-4a7f-8732-c1b6d75f010c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:00:49.833386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:49.833875 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:49.840072 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.840522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.841272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.841703 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.854454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] HTTP exception thrown: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Request method failure captured: May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f HTTP/1.1 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftMvoIodZq9E2xTTEf2HJazrVhJHJbUtRtbKNuFeeVI_EyleLglnyMnvk_KTuKqtm7fWKSgxnUZGGAmDKN12Cg05BOy1DJIpvd6NSX1VnKlTdXFkpe_B_wAoqqrq15Gjn_BXQcDhONAK5B5bwyxRZorGkywjupi0GnlsHQ5LqqA7jKg May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:00:49.856363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2695816a7fb4bd7ab0ea420b156e6e6"}]}] May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: c3a0de9ca12746be893b97d3cd11b826 May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.857905 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '95c1fa86-0199-416e-906e-ecbb3d1e510f'} May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:49.859007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.860483 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:49.862058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Returning 404 to user: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:49.862058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-90ef6f23-8ae4-4203-987a-7d106e64f858 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 404 len: 111 microversion: 2.1 time: 0.028823 May 13 22:00:49.862058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 438/875] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:00:49 2022] DELETE /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:00:49.865982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:49.866585 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] [instance: 95c1fa86-0199-416e-906e-ecbb3d1e510f] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:49.872916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.873344 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.874102 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.874526 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.888144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] HTTP exception thrown: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Request method failure captured: May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f HTTP/1.1 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftMvoIodZq9E2xTTEf2HJazrVhJHJbUtRtbKNuFeeVI_EyleLglnyMnvk_KTuKqtm7fWKSgxnUZGGAmDKN12Cg05BOy1DJIpvd6NSX1VnKlTdXFkpe_B_wAoqqrq15Gjn_BXQcDhONAK5B5bwyxRZorGkywjupi0GnlsHQ5LqqA7jKg May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:00:49.889643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e2695816a7fb4bd7ab0ea420b156e6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e2695816a7fb4bd7ab0ea420b156e6e6"}]}] May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: e2695816a7fb4bd7ab0ea420b156e6e6 May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-TestVolumeBootPattern-572711134 May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: c3a0de9ca12746be893b97d3cd11b826 May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-TestVolumeBootPattern-572711134-project May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.891321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '95c1fa86-0199-416e-906e-ecbb3d1e510f'} May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:49.892137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. May 13 22:00:49.894170 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:00:49.895507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Returning 404 to user: Instance 95c1fa86-0199-416e-906e-ecbb3d1e510f could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:49.895507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f62d43c6-b933-40ec-9810-9fb2ab782927 tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f" status: 404 len: 111 microversion: 2.1 time: 0.028761 May 13 22:00:49.895507 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 438/876] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:49 2022] GET /compute/v2.1/servers/95c1fa86-0199-416e-906e-ecbb3d1e510f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:00:49.950479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:49.951152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:49.957666 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.958118 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:49.958927 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:49.959365 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:50.095404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:50.102650 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d8642e51-c9fb-4d20-a18a-7c5793f2d016 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1680 microversion: 2.1 time: 0.156023 May 13 22:00:50.103479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 439/877] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:49 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:51.120269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:51.121783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:51.129159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:51.129920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:51.130956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:51.131606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:51.208084 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-80015cb3-8fa3-4528-bb3f-d3b524e07bcf tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] Calling method '.version_select at 0x7fb7dffdeee0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:51.233242 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-80015cb3-8fa3-4528-bb3f-d3b524e07bcf tempest-TestVolumeBootPattern-572711134 tempest-TestVolumeBootPattern-572711134-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-476909752" status: 202 len: 0 microversion: 2.1 time: 0.029712 May 13 22:00:51.234026 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 440/878] 10.222.0.35 () {58 vars in 1259 bytes} [Fri May 13 22:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-476909752 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:51.352720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:51.360766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a3523ac6-705b-4430-bcdf-e210f3e31d25 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1680 microversion: 2.1 time: 0.244673 May 13 22:00:51.361531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 439/879] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:51 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:52.068622 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-130095b7-4776-407a-9793-067254906a33 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:52.074885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-130095b7-4776-407a-9793-067254906a33 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.075436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-130095b7-4776-407a-9793-067254906a33 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.097549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-130095b7-4776-407a-9793-067254906a33 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Going to try to stop instance {{(pid=128489) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 22:00:52.142410 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-130095b7-4776-407a-9793-067254906a33 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action" status: 202 len: 0 microversion: 2.1 time: 0.078049 May 13 22:00:52.143859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 441/880] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:00:52 2022] POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:52.161110 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:52.163078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:52.170820 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.171267 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.172223 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.172848 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.288539 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-a161e9f5-3464-47e2-a29e-56dca9b78102 req-77f44c29-a2c3-4223-b17f-aaca43bf3cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509162fe-11c2-46c2-bcb9-806b229cfcfe", "name": "network-vif-deleted", "tag": "b92d864c-4291-4c00-b9d1-a641e24a3814"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:52.302947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-a161e9f5-3464-47e2-a29e-56dca9b78102 req-77f44c29-a2c3-4223-b17f-aaca43bf3cb3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.308083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-a161e9f5-3464-47e2-a29e-56dca9b78102 req-77f44c29-a2c3-4223-b17f-aaca43bf3cb3 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.339961 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-a161e9f5-3464-47e2-a29e-56dca9b78102 req-77f44c29-a2c3-4223-b17f-aaca43bf3cb3 service nova] Creating event network-vif-deleted:b92d864c-4291-4c00-b9d1-a641e24a3814 for instance 509162fe-11c2-46c2-bcb9-806b229cfcfe on hv-cinder-84051 May 13 22:00:52.347963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-a161e9f5-3464-47e2-a29e-56dca9b78102 req-77f44c29-a2c3-4223-b17f-aaca43bf3cb3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064000 May 13 22:00:52.350452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 442/881] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:00:52.385986 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:52.387344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:52.401713 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.402448 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.403509 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:52.404542 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:52.432467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:52.441228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bc8db652-d082-4a33-8759-13781109c4ee tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.293196 May 13 22:00:52.446106 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 440/882] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:52 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:52.636702 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:52.646475 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-aec1a186-4230-4df7-9882-a42f0be9fa86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 200 len: 1612 microversion: 2.1 time: 0.270435 May 13 22:00:52.647784 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 443/883] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:52 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 1612 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:53.460235 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:53.461485 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:53.468370 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:53.469129 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:53.470655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:53.471363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:53.635087 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:53.642976 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d50cbaa0-a5c1-48ae-ac98-cfe89c677535 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.186456 May 13 22:00:53.643919 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 441/884] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:53 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:53.663719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:53.664342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:53.670555 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:53.672391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:53.673419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:53.673864 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:53.689438 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe HTTP/1.1 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:00:53.691136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:00:53.692774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '509162fe-11c2-46c2-bcb9-806b229cfcfe'} May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:00:53.693663 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:00:53.695161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:00:53.698419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:00:53.698419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-db5639db-67b7-44fd-b537-70bd59190319 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 404 len: 111 microversion: 2.1 time: 0.032655 May 13 22:00:53.698419 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 444/885] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:53 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:00:53.701250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cf37bec0-8fd8-4f12-a82b-65a3b142960d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '.version_select at 0x7fb7dfeea820>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:53.719552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cf37bec0-8fd8-4f12-a82b-65a3b142960d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544236913" status: 202 len: 0 microversion: 2.1 time: 0.021939 May 13 22:00:53.720118 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 442/886] 10.222.0.35 () {58 vars in 1220 bytes} [Fri May 13 22:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544236913 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:00:54.493565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c2d4b334-f58b-4c2f-ac6b-6017478f6b48 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: .version_select at 0x7fb7dffd45e0>, body: {"keypair": {"name": "tempest-keypair-1945851953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+w//sQDABBetUXtOIgVTg4v9pywHakwYybEwgFIccwStPi4FW0x5G0FvK41IV0pZDwq6CKPEiXLtaIRENJn4eRXzWyIgcABcqtXfSFoUcoq9UFu9mvLjgUdDqcZ6PFzA=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:54.511223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-c2d4b334-f58b-4c2f-ac6b-6017478f6b48 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:00:54.516604 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-c2d4b334-f58b-4c2f-ac6b-6017478f6b48 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:00:54.568287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c2d4b334-f58b-4c2f-ac6b-6017478f6b48 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078868 May 13 22:00:54.568893 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 445/887] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 22:00:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:00:54.660277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:54.660941 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:54.683312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:54.683770 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:54.685539 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:54.686451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:54.919248 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:54.944512 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ff518219-dfab-4b19-a85c-8a1ba5cb54e7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.288060 May 13 22:00:54.945408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 443/888] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:54 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:55.962311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:55.963001 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:55.972235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:55.972909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:55.974324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:55.974791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:56.099660 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-678862896", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffb86270-54c5-4ed6-9100-3db6f56fe50f"}], "security_groups": [{"name": "tempest-securitygroup--939088492"}], "key_name": "tempest-keypair-1945851953", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:56.120215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:56.129291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fbfe1996-f7ca-4f80-ab45-35c12b769cf7 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.171266 May 13 22:00:56.130082 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 446/889] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:55 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:56.211272 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] validate_networks() for [('ffb86270-54c5-4ed6-9100-3db6f56fe50f', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 22:00:56.588373 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 22:00:56.588797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 22:00:56.589274 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 22:00:56.589691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 22:00:56.590102 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 22:00:56.599454 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:56.599898 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:56.600698 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:56.601135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:56.617972 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:00:56.622321 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Getting quotas for user ce6d80446f54487387c7f58eeb3c83c1 and project a04ed773a4b44bf5b881acbdf51a8463. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:00:56.632977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 22:00:56.635259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 22:00:56.681787 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cb6e75b3-8eda-4375-bb60-1ff5abb6a75e tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.586832 May 13 22:00:56.683048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 444/890] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 22:00:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 22:00:56.692610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e144f373-47ab-4b68-97ec-ea1c792cdfe6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:56.693226 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e144f373-47ab-4b68-97ec-ea1c792cdfe6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:56.761748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e144f373-47ab-4b68-97ec-ea1c792cdfe6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:56.768743 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e144f373-47ab-4b68-97ec-ea1c792cdfe6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1241 microversion: 2.1 time: 0.079943 May 13 22:00:56.769308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 447/891] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:56 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:57.146788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:57.147968 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:57.155703 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:57.157259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:57.159339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:57.160107 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:57.305842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:57.313716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-cd1b576f-fcea-43d8-b522-a66d8fa0f8f6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.171186 May 13 22:00:57.324317 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 445/892] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:57 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:57.785488 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:57.786088 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:57.798076 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:57.798543 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:57.799891 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:57.802325 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:57.900687 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:57.915195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e77fcf37-d065-449e-a15f-1b6bd149eb0c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1301 microversion: 2.1 time: 0.133418 May 13 22:00:57.915783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 448/893] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:57 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:58.332266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:58.332881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:58.342269 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:58.342808 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:58.343781 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:58.344289 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:58.597214 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:58.605639 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-ad3558bf-26da-49d0-9d4c-4bf7d9705bd3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.277949 May 13 22:00:58.608649 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 446/894] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:58 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:58.934484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:58.936185 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:58.944222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:58.945458 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:58.946249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:58.946918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:59.188921 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:59.198759 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0542594c-c345-49f9-8ce8-c0486bf79b11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.269674 May 13 22:00:59.209860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 449/895] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:58 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:59.625154 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:00:59.626230 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:00:59.634442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:59.635143 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:59.636068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:59.636692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:00:59.849780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:00:59.860021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6904c509-4dd1-4f8f-9d92-bb1ffba67bde tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.239189 May 13 22:00:59.862006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 447/896] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:00:59 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:00:59.976638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-80687482-605e-4e04-a8d7-66019c0e2f72 req-45c50dd2-08cb-402d-b9e7-674644f29f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95326641-0743-49d2-9719-ee331cf16224", "tag": "2e0831c3-7654-4574-9f96-038ce1df1fc9"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:00:59.989694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-80687482-605e-4e04-a8d7-66019c0e2f72 req-45c50dd2-08cb-402d-b9e7-674644f29f22 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:00:59.990931 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-80687482-605e-4e04-a8d7-66019c0e2f72 req-45c50dd2-08cb-402d-b9e7-674644f29f22 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:00.003361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-80687482-605e-4e04-a8d7-66019c0e2f72 req-45c50dd2-08cb-402d-b9e7-674644f29f22 service nova] Creating event network-changed:2e0831c3-7654-4574-9f96-038ce1df1fc9 for instance 95326641-0743-49d2-9719-ee331cf16224 on hv-cinder-84051 May 13 22:01:00.012597 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-80687482-605e-4e04-a8d7-66019c0e2f72 req-45c50dd2-08cb-402d-b9e7-674644f29f22 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041225 May 13 22:01:00.016472 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 450/897] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:00.216404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:00.217045 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:00.223468 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:00.223913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:00.224932 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:00.225366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:00.433250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:00.440860 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d80e9466-2e4f-44b9-b81f-55e2e1116057 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.228299 May 13 22:01:00.441422 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 448/898] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:00 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:00.878527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:00.879247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:00.885770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:00.886218 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:00.887016 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:00.887487 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:01.011789 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:01.019540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ea8be9d2-1d86-442c-bb2a-f81923eb2c3d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.145244 May 13 22:01:01.020099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 451/899] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:00 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:01.458017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:01.458658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:01.465042 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:01.465484 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:01.466239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:01.466670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:01.678061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:01.685399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-2bd10618-cba9-4ba3-839b-0b77da414109 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.231880 May 13 22:01:01.685963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 449/900] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:01 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:02.036950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:02.037565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:02.043867 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:02.044319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:02.045083 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:02.045519 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:02.175503 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:02.182657 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-52a70b4c-b14a-4ffb-99aa-da44e4eec4a6 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1678 microversion: 2.1 time: 0.150183 May 13 22:01:02.183245 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 452/901] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:02 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:02.702466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:02.703115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:02.709811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:02.710258 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:02.711035 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:02.711466 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:02.998788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:03.006613 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-25b95544-4c4b-48f3-85cd-d48196afd593 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.307898 May 13 22:01:03.014880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 450/902] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:02 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:03.200763 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:03.201372 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:03.207816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:03.208267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:03.209026 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:03.209461 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:03.340840 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:03.348615 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-de85f7fe-b4bc-4536-9019-ec6b4d2e4cd5 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1655 microversion: 2.1 time: 0.151744 May 13 22:01:03.349186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 453/903] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:03 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:03.365475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-72e23d99-d7e0-41ff-b078-4bb0fa4da06d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:03.371339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72e23d99-d7e0-41ff-b078-4bb0fa4da06d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:03.371801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-72e23d99-d7e0-41ff-b078-4bb0fa4da06d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:03.394145 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-72e23d99-d7e0-41ff-b078-4bb0fa4da06d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Going to try to start instance {{(pid=128488) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 22:01:03.434174 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-72e23d99-d7e0-41ff-b078-4bb0fa4da06d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action" status: 202 len: 0 microversion: 2.1 time: 0.072990 May 13 22:01:03.434788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 451/904] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:01:03 2022] POST /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:01:03.442734 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:03.443330 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:03.449053 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:03.449503 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:03.450260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:03.450692 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:03.826736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:03.834569 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-055f1abc-7756-4847-a83e-a55c490cb559 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1664 microversion: 2.1 time: 0.395620 May 13 22:01:03.835161 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 454/905] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:03 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1664 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:04.024888 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:04.025736 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:04.032053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:04.032511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:04.033933 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:04.034375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:04.206689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:04.214575 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d3782392-5382-4728-9425-6b34dded3c07 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.194446 May 13 22:01:04.215175 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 452/906] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:04 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:04.809940 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-c3d522e1-941b-4f84-8cc8-8e068054c0c1 req-41e89312-4cfb-41a8-a1c4-3f88ed81eff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95326641-0743-49d2-9719-ee331cf16224", "name": "network-vif-plugged", "status": "completed", "tag": "2e0831c3-7654-4574-9f96-038ce1df1fc9"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:04.819678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c3d522e1-941b-4f84-8cc8-8e068054c0c1 req-41e89312-4cfb-41a8-a1c4-3f88ed81eff7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:04.821195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-c3d522e1-941b-4f84-8cc8-8e068054c0c1 req-41e89312-4cfb-41a8-a1c4-3f88ed81eff7 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:04.832861 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-c3d522e1-941b-4f84-8cc8-8e068054c0c1 req-41e89312-4cfb-41a8-a1c4-3f88ed81eff7 service nova] Creating event network-vif-plugged:2e0831c3-7654-4574-9f96-038ce1df1fc9 for instance 95326641-0743-49d2-9719-ee331cf16224 on hv-cinder-84051 May 13 22:01:04.837896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-c3d522e1-941b-4f84-8cc8-8e068054c0c1 req-41e89312-4cfb-41a8-a1c4-3f88ed81eff7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031632 May 13 22:01:04.838515 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 455/907] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:04.851265 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:04.851881 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:04.858047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:04.858500 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:04.859302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:04.859742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:04.984264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:04.992009 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-da0f3e64-86c9-4a2d-96ce-2ae2600d489d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1664 microversion: 2.1 time: 0.144618 May 13 22:01:04.992569 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 453/908] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:04 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1664 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:05.231910 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:05.232612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:05.238872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:05.239328 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:05.240107 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:05.240549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:05.369255 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:05.376357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-98180125-5f14-4e89-8550-f84e03ad0ce3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1366 microversion: 2.1 time: 0.148921 May 13 22:01:05.376934 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 456/909] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:05 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:06.008655 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:06.009233 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:06.015461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.015910 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.016671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.017105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.142129 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:06.149876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9a59d537-eef7-4f44-a3c1-00d6f1024a81 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1668 microversion: 2.1 time: 0.145078 May 13 22:01:06.150643 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 454/910] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:06 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1668 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:06.393570 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:06.394099 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:06.400319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.400769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.401534 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.401967 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.529196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:06.536396 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f4136a22-35de-4a3b-a93d-843d1d93924a tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1555 microversion: 2.1 time: 0.147346 May 13 22:01:06.536957 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 457/911] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:06 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:06.552357 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:06.552845 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:06.558675 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.559152 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.559912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:06.560342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:06.634366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a56a2c41-54c8-4390-84b6-4ed5b75198c3 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085774 May 13 22:01:06.634987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 455/912] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 22:01:06 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:07.577202 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-b2ffa097-e76d-4b2a-9375-84007f3f0ac8 req-2ba5f5e9-5785-4bce-abc2-9ce93e66944c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95326641-0743-49d2-9719-ee331cf16224", "tag": "2e0831c3-7654-4574-9f96-038ce1df1fc9"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:07.585932 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b2ffa097-e76d-4b2a-9375-84007f3f0ac8 req-2ba5f5e9-5785-4bce-abc2-9ce93e66944c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:07.586387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b2ffa097-e76d-4b2a-9375-84007f3f0ac8 req-2ba5f5e9-5785-4bce-abc2-9ce93e66944c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:07.597640 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-b2ffa097-e76d-4b2a-9375-84007f3f0ac8 req-2ba5f5e9-5785-4bce-abc2-9ce93e66944c service nova] Creating event network-changed:2e0831c3-7654-4574-9f96-038ce1df1fc9 for instance 95326641-0743-49d2-9719-ee331cf16224 on hv-cinder-84051 May 13 22:01:07.602571 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-b2ffa097-e76d-4b2a-9375-84007f3f0ac8 req-2ba5f5e9-5785-4bce-abc2-9ce93e66944c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028992 May 13 22:01:07.603208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 458/913] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:38.509786 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:38.510788 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:38.516590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.517038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:38.517821 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.518254 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:38.547400 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d57445ef-e31e-434f-a74b-8327a87af5cb tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042019 May 13 22:01:38.547934 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 456/914] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:01:38 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 22:01:38.603513 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:38.604122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:38.610389 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.610876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:38.611634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.612068 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:38.637029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:01:38.709575 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-181d5100-8d54-4f93-90a5-e396f388bfe9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 204 len: 0 microversion: 2.1 time: 0.109920 May 13 22:01:38.710179 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 459/915] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:01:38 2022] DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:01:38.719996 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:38.720581 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:38.728070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.728536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:38.729312 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:38.729752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:39.123456 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:39.131007 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b9013403-027b-4674-bd37-059dc5884132 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1674 microversion: 2.1 time: 0.416268 May 13 22:01:39.131584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 457/916] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:38 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1674 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:40.150025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:40.150749 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:40.157599 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:40.158058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:40.158902 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:40.160044 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:40.484527 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:40.491748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-92af7250-f714-4b2e-9692-a78ebb84ab86 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1674 microversion: 2.1 time: 0.345989 May 13 22:01:40.492312 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 460/917] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:40 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1674 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:41.508137 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:41.508839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:41.515022 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:41.515467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:41.516225 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:41.516657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:41.598337 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:01:41.599028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Fri May 13 22:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:01:41.693631 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:41.700830 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-512ef442-b46a-4ec6-ae1e-5280517f2e94 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 200 len: 1606 microversion: 2.1 time: 0.196534 May 13 22:01:41.701577 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 458/918] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:41 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 1606 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:01:41.882764 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-5a6a06e7-7cb6-4df0-921b-a5ae143d6afb req-04c9a50d-373a-46ae-9dca-095483bb1371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78905677-ffd1-4408-a985-433304c4dacc", "name": "network-vif-deleted", "tag": "aefeb4bf-8e41-45d1-a8ad-29d0ce76de38"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:41.892400 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5a6a06e7-7cb6-4df0-921b-a5ae143d6afb req-04c9a50d-373a-46ae-9dca-095483bb1371 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:41.892848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5a6a06e7-7cb6-4df0-921b-a5ae143d6afb req-04c9a50d-373a-46ae-9dca-095483bb1371 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:41.905543 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-5a6a06e7-7cb6-4df0-921b-a5ae143d6afb req-04c9a50d-373a-46ae-9dca-095483bb1371 service nova] Creating event network-vif-deleted:aefeb4bf-8e41-45d1-a8ad-29d0ce76de38 for instance 78905677-ffd1-4408-a985-433304c4dacc on hv-cinder-84051 May 13 22:01:41.912992 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-5a6a06e7-7cb6-4df0-921b-a5ae143d6afb req-04c9a50d-373a-46ae-9dca-095483bb1371 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033585 May 13 22:01:41.914209 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 461/919] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:42.718571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:42.719213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:42.726065 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:42.726510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:42.727301 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:42.727729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:42.741493 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc HTTP/1.1 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:01:42.743155 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:01:42.744662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '78905677-ffd1-4408-a985-433304c4dacc'} May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:01:42.745514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:01:42.746839 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:01:42.749058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:01:42.749058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7b01d87b-a107-4b56-8e81-90ee4021e946 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 404 len: 111 microversion: 2.1 time: 0.029877 May 13 22:01:42.749058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 459/920] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:42 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:01:42.754352 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bce59936-b0e4-47f5-b17e-a642e8e35312 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '.version_select at 0x7fb7dffc71f0>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:42.773530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bce59936-b0e4-47f5-b17e-a642e8e35312 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643847957" status: 202 len: 0 microversion: 2.1 time: 0.023698 May 13 22:01:42.774114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 462/921] 10.222.0.35 () {58 vars in 1220 bytes} [Fri May 13 22:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643847957 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:01:43.396920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5c7090f7-85a7-4f33-b0ab-8088cd90899e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: .version_select at 0x7fb7dfeb64c0>, body: {"keypair": {"name": "tempest-keypair-176761811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLuXJMEqEVA5HnLZirhTMM2JyV/rCQqYYbjbDeyP7mOva+yauc5Xj3oCYyfoEYWV6e/6xyUD8FeD406SFBkbU4gDwZ49vfU1WD1zfjN1AMRAZ/DlQc9PZV0msyAw8pe5g=="}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:43.411202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-5c7090f7-85a7-4f33-b0ab-8088cd90899e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for project 9e5d643885114a45b305ac13bef897d3. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:01:43.415070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-5c7090f7-85a7-4f33-b0ab-8088cd90899e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for user dddbe23734ee4cee866d58e3314007ea and project 9e5d643885114a45b305ac13bef897d3. Resources: {'key_pairs'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:01:43.435809 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5c7090f7-85a7-4f33-b0ab-8088cd90899e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043504 May 13 22:01:43.436382 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 460/922] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 22:01:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:43.659077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:43.660222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:43.667034 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:43.667504 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:43.668425 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:43.668873 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:43.695060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-85a4f0e6-6883-41b5-a4f2-b9edcb7d30dd tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/ips" status: 200 len: 148 microversion: 2.1 time: 0.039769 May 13 22:01:43.695799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 463/923] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 22:01:43 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:44.726619 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1360827533", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78fbdc0f-a69d-4b29-8570-901b523fd527"}], "security_groups": [{"name": "tempest-securitygroup--653767555"}], "key_name": "tempest-keypair-176761811", "user_data": "}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:44.823388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] validate_networks() for [('78fbdc0f-a69d-4b29-8570-901b523fd527', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 22:01:45.017612 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "935c6764-82f8-40ca-86bf-dfefea819ecd"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:45.018679 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:45.024984 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:45.025436 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:45.026206 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:45.026645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:45.195441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 22:01:45.195870 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 22:01:45.196349 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 22:01:45.196767 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 22:01:45.197183 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 22:01:45.205853 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:45.206379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:45.207434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:45.207880 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:45.225759 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for project 9e5d643885114a45b305ac13bef897d3. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:01:45.230392 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Getting quotas for user dddbe23734ee4cee866d58e3314007ea and project 9e5d643885114a45b305ac13bef897d3. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:01:45.242038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 22:01:45.244355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 22:01:45.281718 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-0bc8e8d2-888e-491c-8e99-40afff6b16ea tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "POST /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267935 May 13 22:01:45.282668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 464/924] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:01:45 2022] POST /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:45.293461 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-f8741bb1-1b70-4746-8cd0-40df2b7c3d57 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572673 May 13 22:01:45.299054 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 461/925] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 22:01:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 22:01:45.313818 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c24d67e0-e262-4c2c-a7fa-c4929baafcf2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:45.317450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c24d67e0-e262-4c2c-a7fa-c4929baafcf2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:45.377195 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c24d67e0-e262-4c2c-a7fa-c4929baafcf2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:45.386780 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c24d67e0-e262-4c2c-a7fa-c4929baafcf2 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1237 microversion: 2.1 time: 0.077329 May 13 22:01:45.387557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 465/926] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:45 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:46.404877 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:46.405544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:46.412210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:46.412666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:46.413476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:46.413920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:46.488540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:46.496306 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-42b293f2-f7a2-4823-84fc-75194706b1c3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1295 microversion: 2.1 time: 0.095729 May 13 22:01:46.496873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 462/927] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:46 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:01:47.512837 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:47.514021 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:47.521832 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:47.522286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:47.523106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:47.523548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:47.712318 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:47.719702 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c0d0b3fa-ea43-4512-ade9-984497a91b12 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.210786 May 13 22:01:47.720580 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 466/928] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:47 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:47.820451 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-9eea04d6-dcae-4f19-80eb-ad8e78c7e3dc req-580dfadc-e99b-483a-8ebe-357d1bf84971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee2bfeb-d7de-402f-a948-ad706207cf79", "tag": "b321ec03-f9a3-4cea-8d6b-04e905d705e9"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:47.828689 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-9eea04d6-dcae-4f19-80eb-ad8e78c7e3dc req-580dfadc-e99b-483a-8ebe-357d1bf84971 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:47.829176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-9eea04d6-dcae-4f19-80eb-ad8e78c7e3dc req-580dfadc-e99b-483a-8ebe-357d1bf84971 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:47.841535 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-9eea04d6-dcae-4f19-80eb-ad8e78c7e3dc req-580dfadc-e99b-483a-8ebe-357d1bf84971 service nova] Creating event network-changed:b321ec03-f9a3-4cea-8d6b-04e905d705e9 for instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 on hv-cinder-84051 May 13 22:01:47.847109 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-9eea04d6-dcae-4f19-80eb-ad8e78c7e3dc req-580dfadc-e99b-483a-8ebe-357d1bf84971 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030242 May 13 22:01:47.847757 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 463/929] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:48.737059 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:48.737611 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:48.743858 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:48.744308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:48.745070 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:48.745506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:48.869901 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:48.877126 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-82ac53df-d526-49af-bfe5-fb70b1dcd55a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.144000 May 13 22:01:48.877688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 467/930] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:48 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:49.895396 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:49.896090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:49.902437 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:49.902928 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:49.903683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:49.904114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:50.031936 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:50.039779 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a1dd1042-173a-4eb4-9bd9-c523a5c9c833 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.149188 May 13 22:01:50.040345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 464/931] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:49 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:51.056306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:51.056912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:51.063394 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:51.063860 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:51.064638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:51.065170 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:51.191766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:51.198404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a5b075a0-bed4-4674-a91e-273b6b8a917d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.145905 May 13 22:01:51.199025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 468/932] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:51 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:52.214924 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:52.215531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:52.221762 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:52.222208 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:52.222988 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:52.223423 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:52.347977 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:52.355120 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d902d34c-577d-498e-98f3-f4e25329fe64 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.144035 May 13 22:01:52.355943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 465/933] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:52 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:52.857775 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:52.858273 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:52.864514 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:52.864967 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:52.865731 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:52.866172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:52.944659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lazy-loading 'services' on Instance uuid 95326641-0743-49d2-9719-ee331cf16224 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:01:53.015953 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d7a95201-5947-4b5c-80a5-927884b8e043 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments/935c6764-82f8-40ca-86bf-dfefea819ecd" status: 202 len: 0 microversion: 2.1 time: 0.162104 May 13 22:01:53.016738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 469/934] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:01:52 2022] DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments/935c6764-82f8-40ca-86bf-dfefea819ecd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:01:53.025556 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:53.026486 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:53.033075 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:53.033511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:53.034891 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:53.035647 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:53.063825 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-1cd4b080-987b-49f0-8a5f-9bed67ef3ebe req-ff18b653-9bd5-4ecc-a78c-3f96ffc108ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee2bfeb-d7de-402f-a948-ad706207cf79", "name": "network-vif-plugged", "status": "completed", "tag": "b321ec03-f9a3-4cea-8d6b-04e905d705e9"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:53.065930 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3d240262-6fed-46cf-b8e9-eb63a019f5c6 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 May 13 22:01:53.066755 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 466/935] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:01:53 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:53.073320 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-1cd4b080-987b-49f0-8a5f-9bed67ef3ebe req-ff18b653-9bd5-4ecc-a78c-3f96ffc108ac service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:53.073909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-1cd4b080-987b-49f0-8a5f-9bed67ef3ebe req-ff18b653-9bd5-4ecc-a78c-3f96ffc108ac service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:53.087766 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-1cd4b080-987b-49f0-8a5f-9bed67ef3ebe req-ff18b653-9bd5-4ecc-a78c-3f96ffc108ac service nova] Creating event network-vif-plugged:b321ec03-f9a3-4cea-8d6b-04e905d705e9 for instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 on hv-cinder-84051 May 13 22:01:53.092684 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-1cd4b080-987b-49f0-8a5f-9bed67ef3ebe req-ff18b653-9bd5-4ecc-a78c-3f96ffc108ac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 May 13 22:01:53.093461 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 470/936] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:01:53.373464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:53.374078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:53.380442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:53.380913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:53.381664 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:53.382105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:53.516371 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:53.523717 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-010b1bc7-47df-4e87-a22b-a67cefc4a57f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.154022 May 13 22:01:53.524277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 467/937] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:53 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:54.079815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:54.080862 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:54.091541 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.091996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.092834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.093267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.124587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-da8e845b-54d8-49d7-beab-115dc05bc3aa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049657 May 13 22:01:54.125130 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 471/938] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:01:54 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 22:01:54.183732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:54.184239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:54.190082 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.190533 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.191334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.191772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.215377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Going to try to terminate instance {{(pid=128488) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:01:54.289542 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4343db6e-3da5-4248-9c27-3d8f08aa4259 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 204 len: 0 microversion: 2.1 time: 0.109360 May 13 22:01:54.290142 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 468/939] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:01:54 2022] DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:01:54.299364 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:54.301002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:54.306859 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.307308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.308063 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.308498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.441386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:54.448660 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-751167f7-2254-4478-9870-6e8f327a7515 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1679 microversion: 2.1 time: 0.154232 May 13 22:01:54.449211 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 472/940] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:54 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:54.541792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:54.542490 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:54.548761 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.549203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.549959 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:54.550502 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:54.674087 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:54.681383 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-49ad7a56-6d7c-4445-a5f8-c3f0829bd7ce tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.143641 May 13 22:01:54.682064 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 469/941] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:54 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:55.465409 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:55.466015 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:55.472911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:55.473361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:55.474152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:55.474559 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:55.601645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:55.609155 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-42a6872a-82c8-491d-a2a5-7a26f33eef76 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1679 microversion: 2.1 time: 0.147701 May 13 22:01:55.609724 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 473/942] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:55 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:55.698751 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:55.699374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:55.705692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:55.706318 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:55.707181 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:55.708506 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:55.843483 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:55.851264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-00e33c3a-337a-48cf-8a4b-16e53f2e3d10 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1362 microversion: 2.1 time: 0.156382 May 13 22:01:55.851828 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 470/943] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:55 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:56.626341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:56.626974 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:56.633587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:56.634037 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:56.634841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:56.635270 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:56.868262 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:56.869038 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:56.875441 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:56.875998 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:56.876851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:56.877286 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:56.911061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:56.918340 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f57412cd-726f-40bd-9034-586c8b5a497f tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1679 microversion: 2.1 time: 0.295901 May 13 22:01:56.918946 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 474/944] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:56 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:01:57.101619 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:57.109061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c0ba063f-31b3-4140-81ac-263cbb31f348 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1549 microversion: 2.1 time: 0.244614 May 13 22:01:57.109618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 471/945] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:56 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:01:57.125562 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:57.126077 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:57.132009 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.132459 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.133221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.133654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.244251 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3ff2e776-4f6f-4350-8d3c-cc699b095623 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122454 May 13 22:01:57.244856 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 475/946] 10.222.0.35 () {58 vars in 1274 bytes} [Fri May 13 22:01:57 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:57.650910 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-165f1ab8-7173-4de6-bebd-272f46af550a req-8f6ef263-660a-4402-856f-8934d11bbd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95326641-0743-49d2-9719-ee331cf16224", "name": "network-vif-deleted", "tag": "2e0831c3-7654-4574-9f96-038ce1df1fc9"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:57.662079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-165f1ab8-7173-4de6-bebd-272f46af550a req-8f6ef263-660a-4402-856f-8934d11bbd4a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.662533 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-165f1ab8-7173-4de6-bebd-272f46af550a req-8f6ef263-660a-4402-856f-8934d11bbd4a service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.682377 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-165f1ab8-7173-4de6-bebd-272f46af550a req-8f6ef263-660a-4402-856f-8934d11bbd4a service nova] Creating event network-vif-deleted:2e0831c3-7654-4574-9f96-038ce1df1fc9 for instance 95326641-0743-49d2-9719-ee331cf16224 on hv-cinder-84051 May 13 22:01:57.689002 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-165f1ab8-7173-4de6-bebd-272f46af550a req-8f6ef263-660a-4402-856f-8934d11bbd4a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041291 May 13 22:01:57.690185 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 472/947] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:57.935779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:57.936558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:57.943712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.944306 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.945185 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.945736 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.977106 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:57.977730 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:57.978280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lazy-loading 'fault' on Instance uuid 95326641-0743-49d2-9719-ee331cf16224 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:01:58.027160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6d80446f54487387c7f58eeb3c83c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a04ed773a4b44bf5b881acbdf51a8463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:01:58.035105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-86604cf4-9326-4289-8068-1bb5b753294c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 200 len: 1331 microversion: 2.1 time: 0.103102 May 13 22:01:58.035885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 476/948] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:57 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:01:58.287197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-298abea3-7307-4fea-867b-084beb88aa86 req-50b11b0d-5c75-4b95-897b-32639290bc8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee2bfeb-d7de-402f-a948-ad706207cf79", "tag": "b321ec03-f9a3-4cea-8d6b-04e905d705e9"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:01:58.295475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-298abea3-7307-4fea-867b-084beb88aa86 req-50b11b0d-5c75-4b95-897b-32639290bc8e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:58.296132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-298abea3-7307-4fea-867b-084beb88aa86 req-50b11b0d-5c75-4b95-897b-32639290bc8e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:58.309023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-298abea3-7307-4fea-867b-084beb88aa86 req-50b11b0d-5c75-4b95-897b-32639290bc8e service nova] Creating event network-changed:b321ec03-f9a3-4cea-8d6b-04e905d705e9 for instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 on hv-cinder-84051 May 13 22:01:58.314297 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-298abea3-7307-4fea-867b-084beb88aa86 req-50b11b0d-5c75-4b95-897b-32639290bc8e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032260 May 13 22:01:58.315332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 473/949] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:01:59.052748 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:59.053353 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:01:59.059729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:59.060215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:59.061023 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:01:59.061465 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:01:59.077136 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 HTTP/1.1 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:01:59.078831 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:01:59.080535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '95326641-0743-49d2-9719-ee331cf16224'} May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:01:59.084741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:01:59.086319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:01:59.087729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:01:59.087729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-960d90cf-df68-448b-b001-b854cd1f98b4 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 404 len: 111 microversion: 2.1 time: 0.031841 May 13 22:01:59.087729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 477/950] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:01:59 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:01:59.089598 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-273c5aa4-9c1c-4be2-8cf5-477f37c85358 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '.version_select at 0x7fb7dff49a60>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:01:59.108551 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-273c5aa4-9c1c-4be2-8cf5-477f37c85358 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945851953" status: 202 len: 0 microversion: 2.1 time: 0.022982 May 13 22:01:59.109108 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 474/951] 10.222.0.35 () {58 vars in 1220 bytes} [Fri May 13 22:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945851953 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:02:00.852624 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:00.853120 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:00.859659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:00.860121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:00.860884 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:00.861321 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:00.874243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 HTTP/1.1 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:02:00.875790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.877359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '95326641-0743-49d2-9719-ee331cf16224'} May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:00.878814 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.880290 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:00.881754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:00.881754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6a9326d5-9877-4ec1-8e8c-6186b8b6640d tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 404 len: 111 microversion: 2.1 time: 0.028315 May 13 22:02:00.881754 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 478/952] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:00 2022] DELETE /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:00.885987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:00.886723 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 95326641-0743-49d2-9719-ee331cf16224] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:00.893089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:00.893692 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:00.894996 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:00.895443 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:00.908144 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 HTTP/1.1 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:00.909716 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.911331 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '95326641-0743-49d2-9719-ee331cf16224'} May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:00.912239 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. May 13 22:02:00.913697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:00.915030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 95326641-0743-49d2-9719-ee331cf16224 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:00.915030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-fa303bc9-81e0-4a02-be7e-c1724d16da11 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224" status: 404 len: 111 microversion: 2.1 time: 0.028852 May 13 22:02:00.915030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 475/953] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:00 2022] GET /compute/v2.1/servers/95326641-0743-49d2-9719-ee331cf16224 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 22:02:02.042110 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:02.042587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:02.048782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.049232 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.050018 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.050452 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.063105 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe HTTP/1.1 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:02:02.064608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.066147 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '509162fe-11c2-46c2-bcb9-806b229cfcfe'} May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:02.067284 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.068790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.070402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:02.070402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-89b0095e-efbe-41cc-b8b1-cc3129cdd790 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 404 len: 111 microversion: 2.1 time: 0.027670 May 13 22:02:02.070402 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 479/954] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:02 2022] DELETE /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:02.074069 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:02.074677 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 509162fe-11c2-46c2-bcb9-806b229cfcfe] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:02.081460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.081912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.082672 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.083156 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.095896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe HTTP/1.1 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:02.098047 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.099671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '509162fe-11c2-46c2-bcb9-806b229cfcfe'} May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:02.100706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. May 13 22:02:02.102164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.103616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 509162fe-11c2-46c2-bcb9-806b229cfcfe could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:02.103616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-39b34665-4d62-41fe-ac41-4b77e898b25c tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe" status: 404 len: 111 microversion: 2.1 time: 0.029198 May 13 22:02:02.103616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 476/955] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:02 2022] GET /compute/v2.1/servers/509162fe-11c2-46c2-bcb9-806b229cfcfe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:02.107813 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:02.108307 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:02.114045 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.114493 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.115286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.115722 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.128361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 HTTP/1.1 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:02:02.129863 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.131443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '7ed36eeb-83cd-4f94-898a-846513cdf2e0'} May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:02.132484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.133960 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:02.135659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:02.135659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-938dac90-dfe9-451e-ab98-79f7cf0aaca5 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 404 len: 111 microversion: 2.1 time: 0.027521 May 13 22:02:02.135659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 480/956] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:02 2022] DELETE /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:02.139088 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:02.139691 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: 7ed36eeb-83cd-4f94-898a-846513cdf2e0] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:02.145997 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.146447 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.147228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:02.147668 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:02.161314 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 HTTP/1.1 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:02.162850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.164442 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '7ed36eeb-83cd-4f94-898a-846513cdf2e0'} May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:02.165337 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. May 13 22:02:02.166811 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:02.168206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance 7ed36eeb-83cd-4f94-898a-846513cdf2e0 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:02.168206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9e4594d0-65c9-4bed-9d19-f45a07572a86 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0" status: 404 len: 111 microversion: 2.1 time: 0.028853 May 13 22:02:02.168206 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 477/957] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:02 2022] GET /compute/v2.1/servers/7ed36eeb-83cd-4f94-898a-846513cdf2e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 22:02:03.291153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:03.291649 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:03.298030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:03.298484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:03.299289 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:03.300229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:03.313075 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b HTTP/1.1 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:02:03.314582 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.316565 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': 'c7ae0672-baa5-43cc-afeb-8a1bb179818b'} May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:03.317311 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.318835 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:03.320421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:03.320421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6b6798b5-bdaf-465e-83eb-c421d0dead74 tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 404 len: 111 microversion: 2.1 time: 0.029272 May 13 22:02:03.320421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 481/958] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:03 2022] DELETE /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:03.324706 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:03.325342 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] [instance: c7ae0672-baa5-43cc-afeb-8a1bb179818b] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:03.331541 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:03.332014 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:03.332766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:03.333200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:03.346385 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] HTTP exception thrown: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Request method failure captured: May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b HTTP/1.1 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftRPIk-TMZxeYHuAxW5wI0414i7IkGPM1kbUZ3_GNQKFiSV8aQrzRMxoVjJhVfhQb5FqIuNUBfei7yFxIKoK_vYyFKX4QOJW23BxjpzyAIeElw3C86-mJfkz696L5iziltK3mCD8xW-lYEoMPCdpNNgpVEl2iH8IHvljobNo4znts8U May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:03.347917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_a04ed773a4b44bf5b881acbdf51a8463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/a04ed773a4b44bf5b881acbdf51a8463"}]}] May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: a04ed773a4b44bf5b881acbdf51a8463 May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1990666810 May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: ce6d80446f54487387c7f58eeb3c83c1 May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeNegativeTest-1990666810-project May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.349510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'c7ae0672-baa5-43cc-afeb-8a1bb179818b'} May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:03.350517 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. May 13 22:02:03.352104 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:03.353426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] Returning 404 to user: Instance c7ae0672-baa5-43cc-afeb-8a1bb179818b could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:03.353426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1a20287a-bb34-4339-89a9-11052a1829fa tempest-AttachVolumeNegativeTest-1990666810 tempest-AttachVolumeNegativeTest-1990666810-project] 10.222.0.35 "GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b" status: 404 len: 111 microversion: 2.1 time: 0.028331 May 13 22:02:03.353426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 478/959] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:03 2022] GET /compute/v2.1/servers/c7ae0672-baa5-43cc-afeb-8a1bb179818b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:32.157204 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:32.158896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:32.164751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:32.165200 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:32.165966 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:32.166401 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:32.188656 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8f85f236-fabb-4ecb-a79c-0d43ba0bf01f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/ips" status: 200 len: 147 microversion: 2.1 time: 0.035334 May 13 22:02:32.189218 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 482/960] 10.222.0.35 () {58 vars in 1247 bytes} [Fri May 13 22:02:32 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:33.491690 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4ff9e43-e5d2-4823-aadd-88c40324a923"}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:02:33.492742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:33.498616 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:33.499090 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:33.499843 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:33.500276 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:33.743395 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6ed4ead5-d9ae-4cbe-9c43-192a50361e6d tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255706 May 13 22:02:33.744023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 479/961] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:02:33 2022] POST /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:41.209121 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:41.210041 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:41.216305 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:41.216753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:41.217511 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:41.217947 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:41.246159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ac1ecd0f-d8a7-4a5c-ac26-9a728954ab7a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041539 May 13 22:02:41.246719 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 483/962] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:02:41 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:41.257854 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:41.258439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:41.264488 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:41.264937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:41.265701 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:41.266138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:41.293424 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c2e6aeba-55d3-4ea6-9d11-431e90c499b9 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923" status: 200 len: 194 microversion: 2.1 time: 0.040831 May 13 22:02:41.293985 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 480/963] 10.222.0.35 () {58 vars in 1412 bytes} [Fri May 13 22:02:41 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:42.598315 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c00434b1-d065-454d-b584-5bd8ca525cdf"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:02:42.599479 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:42.605995 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:42.606447 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:42.607247 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:42.607690 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:42.852017 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e3e4b5ff-fdd5-4c78-aa4a-411726323143 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "POST /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257978 May 13 22:02:42.852626 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 484/964] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:02:42 2022] POST /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:50.322829 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:50.323868 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:50.330131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.330584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.331378 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.331819 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.360666 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-651480c8-1638-41d3-84d2-de9e306bbb3e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041755 May 13 22:02:50.361204 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 481/965] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:02:50 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:50.503406 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:50.503980 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:50.510096 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.510540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.511327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.511762 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.539440 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d7b23f68-46bc-4be0-9c35-0a76ee5aeac4 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923" status: 200 len: 194 microversion: 2.1 time: 0.040842 May 13 22:02:50.539991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 485/966] 10.222.0.35 () {58 vars in 1412 bytes} [Fri May 13 22:02:50 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:50.549448 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:50.549939 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:50.555747 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.556198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.556960 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:50.557398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:50.637688 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lazy-loading 'services' on Instance uuid 3ee2bfeb-d7de-402f-a948-ad706207cf79 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:02:50.705732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d808c453-8a42-4110-b180-2bd6199c8d89 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923" status: 202 len: 0 microversion: 2.1 time: 0.159991 May 13 22:02:50.706369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 482/967] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:02:50 2022] DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c4ff9e43-e5d2-4823-aadd-88c40324a923 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:02:51.813046 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:51.813583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:51.820689 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:51.821145 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:51.821912 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:51.822391 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:51.850127 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4198af23-41d5-4441-b748-c1a91eb3b477 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c00434b1-d065-454d-b584-5bd8ca525cdf" status: 200 len: 194 microversion: 2.1 time: 0.040516 May 13 22:02:51.850712 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 486/968] 10.222.0.35 () {58 vars in 1412 bytes} [Fri May 13 22:02:51 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c00434b1-d065-454d-b584-5bd8ca525cdf => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:51.861091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:51.861683 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:51.868731 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:51.869179 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:51.869931 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:51.870363 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:51.946460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lazy-loading 'services' on Instance uuid 3ee2bfeb-d7de-402f-a948-ad706207cf79 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:02:52.014378 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-804ce917-75fe-43ab-9ebb-191a1df4e3f1 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c00434b1-d065-454d-b584-5bd8ca525cdf" status: 202 len: 0 microversion: 2.1 time: 0.157313 May 13 22:02:52.015158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 483/969] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:02:51 2022] DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments/c00434b1-d065-454d-b584-5bd8ca525cdf => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:02:53.170228 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:53.171240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:53.178104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.178568 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.179362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.179803 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.207215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2c23ba13-0653-468a-ac90-b9c60fb2708a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040796 May 13 22:02:53.207769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 487/970] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:02:53 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 22:02:53.309493 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:53.310503 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:53.316917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.317630 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.319022 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.319460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.347548 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a08eaf67-fe22-403d-8cc5-5bbca4c17518 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042453 May 13 22:02:53.348030 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 484/971] 10.222.0.35 () {58 vars in 1301 bytes} [Fri May 13 22:02:53 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 22:02:53.402634 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:53.403160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:53.408867 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.409319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.410080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.410517 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.434989 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:02:53.506900 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-cd36066a-b64e-4dfc-8d57-994ccd08e90e tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 204 len: 0 microversion: 2.1 time: 0.107139 May 13 22:02:53.507530 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 488/972] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:53 2022] DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:02:53.515605 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:53.516218 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:53.522202 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.522652 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.523452 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:53.523917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:53.658234 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:02:53.665555 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5f673913-5961-4fff-a544-5bfb60b41026 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1674 microversion: 2.1 time: 0.153744 May 13 22:02:53.666120 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 485/973] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:53 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:02:54.683163 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:54.683908 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:54.690331 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:54.690817 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:54.691590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:54.692025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:54.819224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:02:54.826422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-cedabd5f-1616-4f53-aeae-63dfaa234735 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1674 microversion: 2.1 time: 0.147496 May 13 22:02:54.827022 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 489/974] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:54 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:02:55.844562 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:55.845166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:55.851975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:55.852418 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:55.853618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:55.853618 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:55.943955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddbe23734ee4cee866d58e3314007ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5d643885114a45b305ac13bef897d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:02:55.951167 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-a9a7d861-cabd-4a24-be0d-94f6082b029f tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 200 len: 1607 microversion: 2.1 time: 0.110863 May 13 22:02:55.951729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 486/975] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:55 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:02:56.405993 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-35b9cf1f-4458-4a80-ae2b-83b5828f9504 req-1080ef82-2cc6-4040-b848-1cecc396615f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee2bfeb-d7de-402f-a948-ad706207cf79", "name": "network-vif-deleted", "tag": "b321ec03-f9a3-4cea-8d6b-04e905d705e9"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:02:56.414469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-35b9cf1f-4458-4a80-ae2b-83b5828f9504 req-1080ef82-2cc6-4040-b848-1cecc396615f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:56.414933 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-35b9cf1f-4458-4a80-ae2b-83b5828f9504 req-1080ef82-2cc6-4040-b848-1cecc396615f service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:56.425420 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-35b9cf1f-4458-4a80-ae2b-83b5828f9504 req-1080ef82-2cc6-4040-b848-1cecc396615f service nova] Creating event network-vif-deleted:b321ec03-f9a3-4cea-8d6b-04e905d705e9 for instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 on hv-cinder-84051 May 13 22:02:56.431187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-35b9cf1f-4458-4a80-ae2b-83b5828f9504 req-1080ef82-2cc6-4040-b848-1cecc396615f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265579 May 13 22:02:56.431769 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 490/976] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:02:56.968654 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:56.969270 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:56.976882 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:56.977338 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:56.978115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:56.978552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:56.992956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 HTTP/1.1 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:56.994680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:56.996430 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '3ee2bfeb-d7de-402f-a948-ad706207cf79'} May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:56.997323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:56.999124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:57.001130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:57.001130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7f331d3e-ac62-4ed0-8252-f47866c0fad3 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 404 len: 111 microversion: 2.1 time: 0.031498 May 13 22:02:57.001130 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 487/977] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:56 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:57.005636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-646ecef5-a2f0-4160-bfe7-11bee32db020 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '.version_select at 0x7fb7e0019700>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:57.025688 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-646ecef5-a2f0-4160-bfe7-11bee32db020 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176761811" status: 202 len: 0 microversion: 2.1 time: 0.024187 May 13 22:02:57.026361 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 491/978] 10.222.0.35 () {58 vars in 1217 bytes} [Fri May 13 22:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176761811 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:02:59.893132 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:59.893635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:59.900511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:59.900963 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:59.901727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:59.902163 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:59.915620 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 HTTP/1.1 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:02:59.917138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.918477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '3ee2bfeb-d7de-402f-a948-ad706207cf79'} May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:59.919279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.920505 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:02:59.921729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:59.921729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-34cae5bf-92ae-4692-aa60-4c092e1f9eed tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 404 len: 111 microversion: 2.1 time: 0.029154 May 13 22:02:59.921729 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 488/979] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:02:59 2022] DELETE /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:02:59.927286 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:02:59.928601 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 3ee2bfeb-d7de-402f-a948-ad706207cf79] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:02:59.934613 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:59.935109 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:59.935880 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:02:59.936327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:02:59.949172 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 HTTP/1.1 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:02:59.950815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.952370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '3ee2bfeb-d7de-402f-a948-ad706207cf79'} May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:02:59.953432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. May 13 22:02:59.954938 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:02:59.956277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 3ee2bfeb-d7de-402f-a948-ad706207cf79 could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:02:59.956277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c7131c85-6c4d-4a4f-9247-6e419a78b500 tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79" status: 404 len: 111 microversion: 2.1 time: 0.029341 May 13 22:02:59.956277 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 492/980] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:02:59 2022] GET /compute/v2.1/servers/3ee2bfeb-d7de-402f-a948-ad706207cf79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:03:01.080052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:01.080540 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:01.086937 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:01.087391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:01.088149 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:01.088586 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:01.101422 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc HTTP/1.1 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:03:01.102980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.104614 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '78905677-ffd1-4408-a985-433304c4dacc'} May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:03:01.105938 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.107531 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:03:01.109590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:03:01.109590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-c10f97cd-efd5-4963-86bf-1ada80bca21a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 404 len: 111 microversion: 2.1 time: 0.028072 May 13 22:03:01.109590 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 489/981] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:03:01 2022] DELETE /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:03:01.112677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:01.113373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] [instance: 78905677-ffd1-4408-a985-433304c4dacc] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:01.120149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:01.120594 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:01.121350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:01.121782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:01.135314 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.wsgi [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] HTTP exception thrown: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Request method failure captured: May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: request: GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc HTTP/1.1 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept: application/json May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Accept-Encoding: identity May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Connection: close May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Length: 0 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Content-Type: application/json May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Host: 10.222.0.35 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Openstack-System-Scope: None May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: User-Agent: python-urllib3/1.26.9 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Auth-Token: gAAAAABiftShLGRwBIU404jDKgUSOVaXruZrsjKwxIXhty5v7Dyi_YXznxzCHzBEcNVgcKqwIQLQ4R7siJZB_FHFULZAcbSY5sgZ_wGhYgMLnTT5NVWAC6jV5Oa-q7TNBfidlJNiKBHZ5zU545QggDgXNApM3wIf7R5WyneJkkdlBi9anbw9ToM May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Id: None May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Domain-Name: None May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Identity-Status: Confirmed May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Is-Admin-Project: True May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Id: default May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Domain-Name: Default May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Project-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Role: member,reader May 13 22:03:01.136816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Roles: member,reader May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9e5d643885114a45b305ac13bef897d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9e5d643885114a45b305ac13bef897d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9e5d643885114a45b305ac13bef897d3"}]}] May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Id: 9e5d643885114a45b305ac13bef897d3 May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-Tenant-Name: tempest-AttachVolumeTestJSON-565064498 May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User: tempest-AttachVolumeTestJSON-565064498-project May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Id: default May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Domain-Name: Default May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Id: dddbe23734ee4cee866d58e3314007ea May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: X-User-Name: tempest-AttachVolumeTestJSON-565064498-project May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: method: > May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: exception: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.138399 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: action_args: {'id': '78905677-ffd1-4408-a985-433304c4dacc'} May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:03:01.139505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. May 13 22:03:01.141091 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR nova.api.openstack.wsgi May 13 22:03:01.142421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] Returning 404 to user: Instance 78905677-ffd1-4408-a985-433304c4dacc could not be found. {{(pid=128489) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:03:01.142421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-ce8fd29e-f417-4b99-b156-396ac7218f6a tempest-AttachVolumeTestJSON-565064498 tempest-AttachVolumeTestJSON-565064498-project] 10.222.0.35 "GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc" status: 404 len: 111 microversion: 2.1 time: 0.029315 May 13 22:03:01.142421 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 493/982] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:01 2022] GET /compute/v2.1/servers/78905677-ffd1-4408-a985-433304c4dacc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:03:26.534099 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1773025486", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "networks": [{"uuid": "fce2d962-b1c9-46ad-b4a7-880640fad08c"}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:03:26.585366 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] validate_networks() for [('fce2d962-b1c9-46ad-b4a7-880640fad08c', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 22:03:26.978453 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 22:03:26.978910 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 22:03:26.979388 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 22:03:26.979794 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 22:03:26.980496 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 22:03:26.988932 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:26.989369 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:26.990159 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:26.990591 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:27.006264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Getting quotas for project 2cbf8c168c0549d89ee2ab4f8adf6f34. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:03:27.010606 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Getting quotas for user 9f0a110ecee84825bffd380d8c664ed4 and project 2cbf8c168c0549d89ee2ab4f8adf6f34. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:03:27.020962 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 22:03:27.023865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 22:03:27.067726 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-edf7a4ee-7400-4fe1-91fa-4cc2684954ec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537447 May 13 22:03:27.068355 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 490/983] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 22:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 22:03:27.079019 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c9e35989-bf57-4872-838f-d0bb8019ec3c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:27.079636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c9e35989-bf57-4872-838f-d0bb8019ec3c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:27.130841 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c9e35989-bf57-4872-838f-d0bb8019ec3c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:27.137700 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c9e35989-bf57-4872-838f-d0bb8019ec3c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1219 microversion: 2.1 time: 0.062709 May 13 22:03:27.138254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 494/984] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:27 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:28.154961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-88464745-1fbb-4fb2-b30c-b51df6a2081b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:28.156063 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-88464745-1fbb-4fb2-b30c-b51df6a2081b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:28.209894 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-88464745-1fbb-4fb2-b30c-b51df6a2081b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:28.217298 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-88464745-1fbb-4fb2-b30c-b51df6a2081b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1219 microversion: 2.1 time: 0.066679 May 13 22:03:28.217851 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 491/985] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:28 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:29.234260 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-4a6d876b-2007-495b-a917-ee6d5102a2ef tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:29.234909 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-4a6d876b-2007-495b-a917-ee6d5102a2ef tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:29.289746 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-4a6d876b-2007-495b-a917-ee6d5102a2ef tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:29.296282 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-4a6d876b-2007-495b-a917-ee6d5102a2ef tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1219 microversion: 2.1 time: 0.066073 May 13 22:03:29.296865 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 495/986] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:29 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:30.313124 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-438d29fd-7575-4d00-b25a-55bea90c0cab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:30.313739 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-438d29fd-7575-4d00-b25a-55bea90c0cab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:30.364373 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-438d29fd-7575-4d00-b25a-55bea90c0cab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:30.371324 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-438d29fd-7575-4d00-b25a-55bea90c0cab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1219 microversion: 2.1 time: 0.062042 May 13 22:03:30.371876 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 492/987] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:30 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:31.388370 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:31.389007 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:31.395256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:31.395705 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:31.396464 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:31.396923 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:31.455080 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:31.462827 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b183f946-8fd7-4748-8a46-d4639ce4497a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1223 microversion: 2.1 time: 0.078287 May 13 22:03:31.463380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 496/988] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:31 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:32.478653 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:32.479332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:32.487940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:32.488470 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:32.489245 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:32.489686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:32.558969 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:32.566091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-313ccff2-b6a7-466f-9ec9-f6f259c82645 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1277 microversion: 2.1 time: 0.091382 May 13 22:03:32.566663 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 493/989] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:32 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:33.583654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:33.584267 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:33.591157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:33.591613 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:33.592381 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:33.592820 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:33.788280 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-5d4d1dbc-9485-4b88-9cfc-e7748dcde3c7 req-d8e94e06-1d19-4890-b0e0-c51fc4ad3d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c", "tag": "92321f06-72d1-4f8a-baf7-e6a4cc2bffc0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:03:33.797115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:33.799912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5d4d1dbc-9485-4b88-9cfc-e7748dcde3c7 req-d8e94e06-1d19-4890-b0e0-c51fc4ad3d3c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:33.800464 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-5d4d1dbc-9485-4b88-9cfc-e7748dcde3c7 req-d8e94e06-1d19-4890-b0e0-c51fc4ad3d3c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:33.806576 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5afb5bee-aab3-4259-8e55-f72d1d326fcc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.226674 May 13 22:03:33.812727 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-5d4d1dbc-9485-4b88-9cfc-e7748dcde3c7 req-d8e94e06-1d19-4890-b0e0-c51fc4ad3d3c service nova] Creating event network-changed:92321f06-72d1-4f8a-baf7-e6a4cc2bffc0 for instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c on hv-cinder-84051 May 13 22:03:33.816129 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 497/990] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:33 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:33.818334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-5d4d1dbc-9485-4b88-9cfc-e7748dcde3c7 req-d8e94e06-1d19-4890-b0e0-c51fc4ad3d3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034547 May 13 22:03:33.818843 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 494/991] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:03:34.823548 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:34.824155 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:34.830357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:34.830836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:34.831592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:34.832025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:35.009322 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:35.016584 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-dec05f51-05e0-4ffb-9e59-46ee2a0ec453 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.196857 May 13 22:03:35.017149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 498/992] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:34 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:36.034797 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:36.035511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:36.042115 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:36.042558 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:36.043341 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:36.043774 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:36.169176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:36.176375 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-14eb0055-107a-4844-ba2c-fac62b9d62d7 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.146302 May 13 22:03:36.176931 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 495/993] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:36 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:37.193299 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:37.194005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:37.200950 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:37.201395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:37.202146 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:37.202579 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:37.329308 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:37.336383 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e86689a0-9bfd-4f37-a48b-0938672a919c tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.146919 May 13 22:03:37.336934 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 499/994] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:37 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:38.352927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:38.353538 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:38.360031 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:38.360475 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:38.361227 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:38.361659 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:38.486192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:38.494158 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5bb7c992-0e58-4860-8c54-9f42406f1aa6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.145064 May 13 22:03:38.494773 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 496/995] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:38 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:39.511505 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:39.512288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:39.518879 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:39.519342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:39.520135 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:39.520581 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:39.655795 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:39.663590 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-bc3b1b35-aa43-4d0e-9179-b255b11a280b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.156329 May 13 22:03:39.664150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 500/996] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:39 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:39.887539 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-1f17b1d8-119d-4d10-a09f-df585c6d4b14 req-8d5e8152-b878-44b6-b57f-b6c5f3e5e3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c", "name": "network-vif-plugged", "status": "completed", "tag": "92321f06-72d1-4f8a-baf7-e6a4cc2bffc0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:03:39.895469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-1f17b1d8-119d-4d10-a09f-df585c6d4b14 req-8d5e8152-b878-44b6-b57f-b6c5f3e5e3f1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:39.895916 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-1f17b1d8-119d-4d10-a09f-df585c6d4b14 req-8d5e8152-b878-44b6-b57f-b6c5f3e5e3f1 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:39.906943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-1f17b1d8-119d-4d10-a09f-df585c6d4b14 req-8d5e8152-b878-44b6-b57f-b6c5f3e5e3f1 service nova] Creating event network-vif-plugged:92321f06-72d1-4f8a-baf7-e6a4cc2bffc0 for instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c on hv-cinder-84051 May 13 22:03:39.911969 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-1f17b1d8-119d-4d10-a09f-df585c6d4b14 req-8d5e8152-b878-44b6-b57f-b6c5f3e5e3f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146078 May 13 22:03:39.912558 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 497/997] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:03:40.680963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:40.681583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:40.687881 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:40.688380 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:40.689186 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:40.689681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:40.814735 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:40.821888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-258bec0f-5341-4542-9c96-bf1e278f2329 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1319 microversion: 2.1 time: 0.145362 May 13 22:03:40.822455 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 501/998] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:40 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:03:41.840307 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:03:41.840999 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:41.847131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:41.847577 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:41.848332 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:41.848766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:41.975580 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:03:41.982982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-bc6ce3a7-6c3e-4541-a319-7d8e9d0d0e2f tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1507 microversion: 2.1 time: 0.147892 May 13 22:03:41.983541 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 498/999] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:03:41 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:03:57.062182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cebb175-2f22-4f9c-a0e4-7cc4631b6eac", "device": "/dev/sdb"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:03:57.063770 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:03:57.069842 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:57.070335 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:57.071152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:03:57.071595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:03:57.325680 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-42953883-d227-403e-9b25-f0d2d0584d93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "POST /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267220 May 13 22:03:57.326474 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 502/1000] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:03:57 2022] POST /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:04:17.992404 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:17.992899 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:17.999467 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:17.999924 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:18.000694 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:18.001135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:18.078987 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lazy-loading 'services' on Instance uuid 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:04:18.147509 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-75b8ec12-0f83-477a-bb3b-0c8b102d20f9 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c/os-volume_attachments/1cebb175-2f22-4f9c-a0e4-7cc4631b6eac" status: 202 len: 0 microversion: 2.1 time: 0.158751 May 13 22:04:18.148152 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 499/1001] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:04:17 2022] DELETE /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c/os-volume_attachments/1cebb175-2f22-4f9c-a0e4-7cc4631b6eac => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:04:19.259963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:19.260581 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:19.267102 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:19.267556 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:19.268325 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:19.268782 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:19.292258 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:04:19.365796 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-585764f4-c2c2-477c-be84-5ed7c278a9a2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 204 len: 0 microversion: 2.1 time: 0.110431 May 13 22:04:19.366507 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 503/1002] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:04:19 2022] DELETE /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:04:19.375861 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:19.376565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:19.383230 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:19.383681 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:19.385079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:19.385518 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:19.512574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:19.519835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-958bec15-2585-4f3b-9569-abcac68737e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1513 microversion: 2.1 time: 0.148230 May 13 22:04:19.520398 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 500/1003] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:19 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:20.537625 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:20.538327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:20.544598 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:20.545048 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:20.545815 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:20.546254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:20.680005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:20.687241 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-131a8fdc-f551-4552-83fa-5d473a2d939b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1513 microversion: 2.1 time: 0.153880 May 13 22:04:20.687822 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 504/1004] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:20 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:21.570166 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-b2a3c497-3f88-4231-8231-fa1b15957567 req-a00ee9db-6942-412a-b2d1-4b0437bcae85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c", "name": "network-vif-deleted", "tag": "92321f06-72d1-4f8a-baf7-e6a4cc2bffc0"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:04:21.579029 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b2a3c497-3f88-4231-8231-fa1b15957567 req-a00ee9db-6942-412a-b2d1-4b0437bcae85 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:21.579472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-b2a3c497-3f88-4231-8231-fa1b15957567 req-a00ee9db-6942-412a-b2d1-4b0437bcae85 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:21.590920 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-b2a3c497-3f88-4231-8231-fa1b15957567 req-a00ee9db-6942-412a-b2d1-4b0437bcae85 service nova] Creating event network-vif-deleted:92321f06-72d1-4f8a-baf7-e6a4cc2bffc0 for instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c on hv-cinder-84051 May 13 22:04:21.595801 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-b2a3c497-3f88-4231-8231-fa1b15957567 req-a00ee9db-6942-412a-b2d1-4b0437bcae85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 May 13 22:04:21.596393 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 501/1005] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:04:21.705358 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:21.705982 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:21.712821 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:21.713279 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:21.714049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:21.714488 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:21.746269 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:21.746665 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:21.747158 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lazy-loading 'fault' on Instance uuid 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:04:21.787557 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:21.795294 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-558c512a-8297-4ced-bf2a-b293dd17ecc0 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 200 len: 1309 microversion: 2.1 time: 0.093860 May 13 22:04:21.795849 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 505/1006] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:21 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:22.814033 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:22.814755 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:22.820838 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:22.821286 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:22.822077 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:22.822516 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:22.835259 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] HTTP exception thrown: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Request method failure captured: May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c HTTP/1.1 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftWt5vc9u1FrOdKMJ9lJDIb7bRyXXNLC4tVHp5OyALkKPM6JcNZlGjZodddemNlfeZGOWH5OoOyFpmmRbex-mOCYlOeCuOKFwzjED_LQxBzkPYdd29c5K9_BiAaJ5Od71JUdV_Zv6Asm5Ows8GqqohlcxwbNLQ0uXfW9Fzn0DcFW9xg May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 2cbf8c168c0549d89ee2ab4f8adf6f34 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:04:22.836856 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}] May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 2cbf8c168c0549d89ee2ab4f8adf6f34 May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesSnapshotTestJSON-18226852-project May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 9f0a110ecee84825bffd380d8c664ed4 May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesSnapshotTestJSON-18226852-project May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. May 13 22:04:22.838635 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c'} May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:04:22.839544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. May 13 22:04:22.840879 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:04:22.842053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Returning 404 to user: Instance 4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:04:22.842053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-03b7eb14-d969-4a41-b53f-0164110cdd93 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c" status: 404 len: 111 microversion: 2.1 time: 0.029156 May 13 22:04:22.842053 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 502/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:22 2022] GET /compute/v2.1/servers/4a73ac3a-07a8-46d0-ba33-0b961e5fcc3c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:04:30.586168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1819452558", "imageRef": "49834e97-02d0-422c-b70f-86503ae2a90b", "flavorRef": "452", "networks": [{"uuid": "fce2d962-b1c9-46ad-b4a7-880640fad08c"}]}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:04:30.635368 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.network.neutron [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] validate_networks() for [('fce2d962-b1c9-46ad-b4a7-880640fad08c', None, None, None, None, None)] {{(pid=128489) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 22:04:31.059738 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Flavor limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 22:04:31.060157 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Image limits 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 22:04:31.060627 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Flavor pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 22:04:31.061032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Image pref 0:0:0 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 22:04:31.061439 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.virt.hardware [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128489) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 22:04:31.069911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:31.070356 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:31.071182 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:31.071664 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:31.087350 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Getting quotas for project 2cbf8c168c0549d89ee2ab4f8adf6f34. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:04:31.091146 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Getting quotas for user 9f0a110ecee84825bffd380d8c664ed4 and project 2cbf8c168c0549d89ee2ab4f8adf6f34. Resources: {'cores', 'instances', 'ram'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:04:31.101535 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Going to run 1 instances... {{(pid=128489) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 22:04:31.104256 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49834e97-02d0-422c-b70f-86503ae2a90b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128489) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 22:04:31.147443 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fb06ae12-3f1e-467f-aa45-33b74b08df5a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565010 May 13 22:04:31.148081 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 506/1008] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 22:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 22:04:31.158693 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-d6a988a6-2cb1-4df4-9d3a-5401e2afdc24 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:31.159334 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-d6a988a6-2cb1-4df4-9d3a-5401e2afdc24 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:31.221048 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-d6a988a6-2cb1-4df4-9d3a-5401e2afdc24 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:31.228203 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-d6a988a6-2cb1-4df4-9d3a-5401e2afdc24 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1219 microversion: 2.1 time: 0.073507 May 13 22:04:31.228760 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 503/1009] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:31 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:32.245751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:32.246359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:32.252779 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:32.253229 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:32.253991 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:32.254423 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:32.323788 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:32.331122 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6f5538c2-b87d-4519-b964-6595e7c3c200 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1277 microversion: 2.1 time: 0.089651 May 13 22:04:32.331700 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 507/1010] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:32 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:33.348799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:33.349387 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:33.357220 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:33.357673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:33.358445 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:33.358912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:33.376069 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-f40fc591-87d6-436d-906e-f58061ec7e06 req-b4b3a4e8-71d6-42a4-99d9-179378f5890c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd0149b-5125-4ea1-877f-d74b066c1460", "tag": "77e39bcb-e254-477b-bb1d-1d404d8628c6"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:04:33.386221 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f40fc591-87d6-436d-906e-f58061ec7e06 req-b4b3a4e8-71d6-42a4-99d9-179378f5890c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:33.386996 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-f40fc591-87d6-436d-906e-f58061ec7e06 req-b4b3a4e8-71d6-42a4-99d9-179378f5890c service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:33.401357 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-f40fc591-87d6-436d-906e-f58061ec7e06 req-b4b3a4e8-71d6-42a4-99d9-179378f5890c service nova] Creating event network-changed:77e39bcb-e254-477b-bb1d-1d404d8628c6 for instance 6dd0149b-5125-4ea1-877f-d74b066c1460 on hv-cinder-84051 May 13 22:04:33.406334 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-f40fc591-87d6-436d-906e-f58061ec7e06 req-b4b3a4e8-71d6-42a4-99d9-179378f5890c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 May 13 22:04:33.407203 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 508/1011] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:04:33.588510 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:33.595789 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-54fb2852-b348-4482-8fee-c75a1fb15df2 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1319 microversion: 2.1 time: 0.250945 May 13 22:04:33.596359 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 504/1012] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:33 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:34.614196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:34.614911 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:34.621489 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:34.621936 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:34.622696 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:34.623152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:34.845208 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:34.852471 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-fcc95bc1-29eb-4a34-8702-ee2d5c57fd52 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1319 microversion: 2.1 time: 0.242907 May 13 22:04:34.853558 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 509/1013] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:34 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:35.870432 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:35.871049 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:35.877524 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:35.877975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:35.878965 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:35.879407 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:36.020427 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:36.028198 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-00415690-5a80-4ad7-873d-296843942e96 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1319 microversion: 2.1 time: 0.162180 May 13 22:04:36.029091 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 505/1014] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:35 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:37.044887 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:37.045450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:37.051741 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:37.052197 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:37.052962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:37.053405 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:37.177890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:37.185343 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-042fcc3c-2fb0-4ba3-9da0-613f4c8e29ab tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1319 microversion: 2.1 time: 0.144320 May 13 22:04:37.185918 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 510/1015] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:37 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:38.082632 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-78c6b0ce-f8a0-434a-bff5-40ae4c504fcd req-34490eef-9896-4f18-bfd2-71f586bece47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd0149b-5125-4ea1-877f-d74b066c1460", "name": "network-vif-plugged", "status": "completed", "tag": "77e39bcb-e254-477b-bb1d-1d404d8628c6"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:04:38.092545 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-78c6b0ce-f8a0-434a-bff5-40ae4c504fcd req-34490eef-9896-4f18-bfd2-71f586bece47 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:38.092995 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-78c6b0ce-f8a0-434a-bff5-40ae4c504fcd req-34490eef-9896-4f18-bfd2-71f586bece47 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:38.105673 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-78c6b0ce-f8a0-434a-bff5-40ae4c504fcd req-34490eef-9896-4f18-bfd2-71f586bece47 service nova] Creating event network-vif-plugged:77e39bcb-e254-477b-bb1d-1d404d8628c6 for instance 6dd0149b-5125-4ea1-877f-d74b066c1460 on hv-cinder-84051 May 13 22:04:38.110783 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-78c6b0ce-f8a0-434a-bff5-40ae4c504fcd req-34490eef-9896-4f18-bfd2-71f586bece47 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 May 13 22:04:38.111697 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 506/1016] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:04:38.202115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:38.202767 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:38.209159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:38.209616 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:38.210376 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:38.210848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:38.396948 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:38.405450 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b5b946e7-580c-4593-a0ea-8ebfb90c5043 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1319 microversion: 2.1 time: 0.206926 May 13 22:04:38.406029 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 511/1017] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:38 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:39.422323 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:39.422980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:39.429730 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:39.430219 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:39.431658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:39.432102 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:39.558339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:04:39.565555 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-5692303a-d8ec-4485-92e2-8f5e540b53e5 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1508 microversion: 2.1 time: 0.147478 May 13 22:04:39.566118 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 507/1018] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:04:39 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:04:39.581694 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af33169-e8c0-4914-b6c9-b7b7dfb08356", "device": "/dev/sdb"}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:04:39.582846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:39.589478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:39.589929 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:39.590681 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:39.591142 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:39.948317 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-321fe5d8-9916-40cc-933f-53a2d28f1080 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "POST /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369929 May 13 22:04:39.948939 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 512/1019] 10.222.0.35 () {60 vars in 1322 bytes} [Fri May 13 22:04:39 2022] POST /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:04:59.185942 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:04:59.186439 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:04:59.192472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:59.192929 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:59.193707 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:04:59.194147 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:04:59.273721 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.objects.instance [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lazy-loading 'services' on Instance uuid 6dd0149b-5125-4ea1-877f-d74b066c1460 {{(pid=128488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:04:59.341678 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7a12f0cc-e796-4c30-bfe9-7ee5d0fcf4cc tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460/os-volume_attachments/9af33169-e8c0-4914-b6c9-b7b7dfb08356" status: 202 len: 0 microversion: 2.1 time: 0.159624 May 13 22:04:59.342299 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 508/1020] 10.222.0.35 () {58 vars in 1415 bytes} [Fri May 13 22:04:59 2022] DELETE /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460/os-volume_attachments/9af33169-e8c0-4914-b6c9-b7b7dfb08356 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:05:00.452777 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:00.453362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:00.460032 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:00.460469 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:00.461230 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:00.461716 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:00.486104 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:05:00.570194 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7a52b4a4-4579-4ce3-a412-b1bd89da5250 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 204 len: 0 microversion: 2.1 time: 0.121377 May 13 22:05:00.571005 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 513/1021] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:05:00 2022] DELETE /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:05:00.582835 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:00.584023 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:00.590247 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:00.590687 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:00.591514 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:00.591944 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:00.724353 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:00.732004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e05bc042-7ba2-4af4-a927-48ed051bf9e6 tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1514 microversion: 2.1 time: 0.156053 May 13 22:05:00.732574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 509/1022] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:00 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:01.749888 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:01.750608 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:01.756895 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:01.757345 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:01.758115 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:01.759085 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:01.882643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:01.890428 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-be0ab08b-1217-4889-b821-8804e7aceeec tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1514 microversion: 2.1 time: 0.144727 May 13 22:05:01.891025 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 514/1023] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:01 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:02.908236 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:02.908853 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:02.917715 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:02.918186 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:02.919491 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:02.920105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:02.991288 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-5a8da25b-e61a-4c36-847c-fa7edd08d5cd req-07bca57b-0125-4f38-9286-11e846ad8d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd0149b-5125-4ea1-877f-d74b066c1460", "name": "network-vif-deleted", "tag": "77e39bcb-e254-477b-bb1d-1d404d8628c6"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:05:03.001298 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5a8da25b-e61a-4c36-847c-fa7edd08d5cd req-07bca57b-0125-4f38-9286-11e846ad8d8e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:03.002223 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-5a8da25b-e61a-4c36-847c-fa7edd08d5cd req-07bca57b-0125-4f38-9286-11e846ad8d8e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:03.006693 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f0a110ecee84825bffd380d8c664ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbf8c168c0549d89ee2ab4f8adf6f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:03.014088 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-9007da6b-782f-416f-8152-352539c3d20b tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 200 len: 1472 microversion: 2.1 time: 0.109939 May 13 22:05:03.014740 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 510/1024] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:02 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:03.022540 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-5a8da25b-e61a-4c36-847c-fa7edd08d5cd req-07bca57b-0125-4f38-9286-11e846ad8d8e service nova] Creating event network-vif-deleted:77e39bcb-e254-477b-bb1d-1d404d8628c6 for instance 6dd0149b-5125-4ea1-877f-d74b066c1460 on hv-cinder-84051 May 13 22:05:03.028183 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-5a8da25b-e61a-4c36-847c-fa7edd08d5cd req-07bca57b-0125-4f38-9286-11e846ad8d8e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040453 May 13 22:05:03.028787 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 515/1025] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:05:04.031327 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:04.031943 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] [instance: 6dd0149b-5125-4ea1-877f-d74b066c1460] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:04.038070 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:04.038511 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:04.039300 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:04.040223 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:04.053913 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] HTTP exception thrown: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Request method failure captured: May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 HTTP/1.1 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftWt5vc9u1FrOdKMJ9lJDIb7bRyXXNLC4tVHp5OyALkKPM6JcNZlGjZodddemNlfeZGOWH5OoOyFpmmRbex-mOCYlOeCuOKFwzjED_LQxBzkPYdd29c5K9_BiAaJ5Od71JUdV_Zv6Asm5Ows8GqqohlcxwbNLQ0uXfW9Fzn0DcFW9xg May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: 2cbf8c168c0549d89ee2ab4f8adf6f34 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:05:04.056210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2cbf8c168c0549d89ee2ab4f8adf6f34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2cbf8c168c0549d89ee2ab4f8adf6f34"}]}] May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: 2cbf8c168c0549d89ee2ab4f8adf6f34 May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-18226852 May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-VolumesSnapshotTestJSON-18226852-project May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: 9f0a110ecee84825bffd380d8c664ed4 May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-VolumesSnapshotTestJSON-18226852-project May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. May 13 22:05:04.058017 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': '6dd0149b-5125-4ea1-877f-d74b066c1460'} May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:05:04.059072 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. May 13 22:05:04.060738 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:05:04.062213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] Returning 404 to user: Instance 6dd0149b-5125-4ea1-877f-d74b066c1460 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:05:04.062213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-514b7e2d-112a-4e9b-bdd8-15e663e2e17a tempest-VolumesSnapshotTestJSON-18226852 tempest-VolumesSnapshotTestJSON-18226852-project] 10.222.0.35 "GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460" status: 404 len: 111 microversion: 2.1 time: 0.030101 May 13 22:05:04.062213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 511/1026] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:04 2022] GET /compute/v2.1/servers/6dd0149b-5125-4ea1-877f-d74b066c1460 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:05:14.416627 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:05:14.417277 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:05:35.619002 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Action: 'create', calling method: .version_select at 0x7fb7dffc23a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1499381974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwWo+kwvDzuZn/eWeH46i5KMzBJsVE/ZTGq7uQyCYe4G58G4JcFfc9QqLIcEUem7MlApw8T7yH1g0vgZYbQoaFENM55HJIReHmQkYnBhFbOuY+MQ47rbnQgxj9ppJA9xg=="}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:05:35.632451 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Getting quotas for project e1c01b24fcbc4cbfa59373f7c804781d. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:05:35.636212 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.quota [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Getting quotas for user b1e4fe6d0ffd4bc7bdf1314b0379e4cc and project e1c01b24fcbc4cbfa59373f7c804781d. Resources: {'key_pairs'} {{(pid=128489) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:05:35.647671 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [0742f434-b8db-42d9-9dd8-7e08e373f2f3] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 22:05:36.655489 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [0742f434-b8db-42d9-9dd8-7e08e373f2f3] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 37106. May 13 22:05:36.671532 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6033000e-091f-4ecd-8c87-202bf6ceec85 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.226232 May 13 22:05:36.672149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 516/1027] 10.222.0.35 () {60 vars in 1158 bytes} [Fri May 13 22:05:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:05:51.704680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2048002238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1499381974", "security_groups": [{"name": "tempest-secgroup-smoke-355301718"}], "networks": [{"uuid": "bf4991b7-0e66-4ff0-aab4-e878ef678082"}], "block_device_mapping_v2": [{"uuid": "561d7fe9-093a-4e24-bd50-8744e190f09d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:05:51.822085 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.network.neutron [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] validate_networks() for [('bf4991b7-0e66-4ff0-aab4-e878ef678082', None, None, None, None, None)] {{(pid=128488) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 22:05:52.177576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Flavor limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 22:05:52.178004 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Image limits 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 22:05:52.178487 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Flavor pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 22:05:52.178940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Image pref 0:0:0 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 22:05:52.179408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.virt.hardware [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 22:05:52.187865 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:52.188316 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:52.189135 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:52.189565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:52.206215 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Getting quotas for project e1c01b24fcbc4cbfa59373f7c804781d. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 22:05:52.210138 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.quota [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Getting quotas for user b1e4fe6d0ffd4bc7bdf1314b0379e4cc and project e1c01b24fcbc4cbfa59373f7c804781d. Resources: {'cores', 'instances', 'ram'} {{(pid=128488) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 22:05:52.266062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Going to run 1 instances... {{(pid=128488) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 22:05:52.268172 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='561d7fe9-093a-4e24-bd50-8744e190f09d',volume_size=None,volume_type=None)] {{(pid=128488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 22:05:52.389133 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-e5250b87-5ba8-4570-b774-2ec61c772c96 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688338 May 13 22:05:52.389763 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 512/1028] 10.222.0.35 () {60 vars in 1146 bytes} [Fri May 13 22:05:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 22:05:52.400060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-7b3b7c17-ebdf-4897-bb04-79fd61aa04dc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:52.400788 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-7b3b7c17-ebdf-4897-bb04-79fd61aa04dc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:52.453659 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-7b3b7c17-ebdf-4897-bb04-79fd61aa04dc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:52.460621 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-7b3b7c17-ebdf-4897-bb04-79fd61aa04dc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1089 microversion: 2.1 time: 0.064884 May 13 22:05:52.461287 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 517/1029] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:52 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:53.478114 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:53.478671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:53.484890 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:53.485339 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:53.486101 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:53.486536 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:53.548687 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:53.556217 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-0e6c665c-b64e-48e8-9528-6e70e35488a6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1187 microversion: 2.1 time: 0.082587 May 13 22:05:53.556790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 513/1030] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:53 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:54.574072 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:54.574677 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:54.580846 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:54.581291 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:54.582049 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:54.582478 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:54.778678 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:54.785976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1693e05b-57a4-448e-993b-2bc6516a89e4 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.216417 May 13 22:05:54.786628 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 518/1031] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:54 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:55.108081 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-1b5722ed-e617-4729-9ad3-84f88f2757f7 req-2f944340-0c89-4dc3-b874-cd3edad12aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:05:55.119266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-1b5722ed-e617-4729-9ad3-84f88f2757f7 req-2f944340-0c89-4dc3-b874-cd3edad12aa8 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:55.119915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-1b5722ed-e617-4729-9ad3-84f88f2757f7 req-2f944340-0c89-4dc3-b874-cd3edad12aa8 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:55.135732 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-1b5722ed-e617-4729-9ad3-84f88f2757f7 req-2f944340-0c89-4dc3-b874-cd3edad12aa8 service nova] Creating event network-changed:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:05:55.141128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-1b5722ed-e617-4729-9ad3-84f88f2757f7 req-2f944340-0c89-4dc3-b874-cd3edad12aa8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037037 May 13 22:05:55.142080 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 514/1032] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:05:55.802638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:55.803278 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:55.810191 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:55.810641 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:55.811506 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:55.811945 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:56.273937 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:56.281675 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-88d54506-8bf0-4804-a843-d3f98c4fcbdd tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.483120 May 13 22:05:56.282249 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 519/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:55 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:57.299429 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:57.300128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:57.306235 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:57.306686 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:57.307469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:57.307904 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:57.443993 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:57.451917 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-64620a69-9c54-4aad-ba21-793e3cd4ec80 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.157142 May 13 22:05:57.452508 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 515/1034] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:57 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:58.469027 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:58.469643 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:58.476061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:58.476498 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:58.477272 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:58.477710 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:58.604003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:58.611471 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-e59cfe51-37c7-442c-90a4-c8946df0bc2f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.146361 May 13 22:05:58.612061 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 520/1035] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:58 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:05:59.628128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:05:59.628766 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:05:59.635131 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:59.635669 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:59.636434 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:05:59.636866 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:05:59.767671 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:05:59.774863 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-90c4e7ab-3ed2-403d-920b-0442ff01279f tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.150534 May 13 22:05:59.775425 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 516/1036] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:05:59 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:00.793426 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:00.794039 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:00.800422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:00.800872 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:00.801638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:00.802072 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:00.927131 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:00.934945 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-5a57de45-ba73-4de7-bb88-b701424d98f6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.145895 May 13 22:06:00.935507 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 521/1037] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:00 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:01.951391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:01.952029 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:01.958362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:01.958841 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:01.959633 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:01.960068 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:02.091537 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:02.098824 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-47240366-1fc0-49d8-83b9-7879e94ec551 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.151220 May 13 22:06:02.099391 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 517/1038] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:01 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:03.116567 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:03.117166 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:03.124175 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:03.124623 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:03.125409 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:03.125868 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:03.255384 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:03.262496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-d0558df2-bd9a-4d77-b81d-b3bf0a54b7fe tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.149903 May 13 22:06:03.263079 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 522/1039] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:03 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:04.279565 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:04.280171 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:04.286615 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:04.287089 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:04.287840 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:04.288287 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:04.413187 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:04.420971 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1562faa8-7ab8-4092-84f8-236cf48769f1 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.145753 May 13 22:06:04.421527 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 518/1040] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:04 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:05.437753 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:05.438351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:05.444583 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:05.445030 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:05.445791 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:05.446222 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:05.576916 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:05.584107 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-913a5599-c841-47df-b0e4-9087abd62d7a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.150213 May 13 22:06:05.584693 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 523/1041] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:05 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:06.601064 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:06.601684 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:06.606168 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [req-b946a459-82d7-492a-ab6d-a171877be8b6 req-35aaaf5f-08ad-48ad-aa53-f5f8d112ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "name": "network-vif-plugged", "status": "completed", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:06:06.608584 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:06.609036 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:06.609804 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:06.610238 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:06.616114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b946a459-82d7-492a-ab6d-a171877be8b6 req-35aaaf5f-08ad-48ad-aa53-f5f8d112ce85 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:06.617235 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [req-b946a459-82d7-492a-ab6d-a171877be8b6 req-35aaaf5f-08ad-48ad-aa53-f5f8d112ce85 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:06.628636 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.compute.server_external_events [req-b946a459-82d7-492a-ab6d-a171877be8b6 req-35aaaf5f-08ad-48ad-aa53-f5f8d112ce85 service nova] Creating event network-vif-plugged:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:06:06.634240 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [req-b946a459-82d7-492a-ab6d-a171877be8b6 req-35aaaf5f-08ad-48ad-aa53-f5f8d112ce85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 May 13 22:06:06.635102 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 524/1042] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:06:06.757720 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:06.765757 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-7de39e84-8706-41fc-8805-90153906a919 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.168665 May 13 22:06:06.766573 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 519/1043] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:06 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:07.783404 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:07.784089 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:07.790484 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:07.790962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:07.791724 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:07.792160 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:07.928375 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:07.936265 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-a9579185-2661-43a5-a9ff-09683bfd792d tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1260 microversion: 2.1 time: 0.157039 May 13 22:06:07.936834 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 525/1044] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:07 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:08.952745 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:08.953350 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:08.959600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:08.960044 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:08.960795 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:08.961222 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:09.100742 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:09.108492 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-209982cd-c0c1-432d-a7d6-45a9f9f260fa tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1444 microversion: 2.1 time: 0.159449 May 13 22:06:09.109071 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 520/1045] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:08 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:09.124280 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:06:09.124885 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:06:09.131154 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:09.131601 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:09.132363 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:09.132790 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:09.264699 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:06:09.271896 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b397bf1e-00a5-4c1f-b025-5495fb4430f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1444 microversion: 2.1 time: 0.151456 May 13 22:06:09.272454 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 526/1046] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:06:09 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:06:10.943308 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-153ac43f-84fe-49f4-9b1c-82670ed5c3bc req-a0aa5dd6-b2e7-48db-8294-545782f0edee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:06:10.952192 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-153ac43f-84fe-49f4-9b1c-82670ed5c3bc req-a0aa5dd6-b2e7-48db-8294-545782f0edee service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:06:10.952638 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-153ac43f-84fe-49f4-9b1c-82670ed5c3bc req-a0aa5dd6-b2e7-48db-8294-545782f0edee service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:06:10.963271 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-153ac43f-84fe-49f4-9b1c-82670ed5c3bc req-a0aa5dd6-b2e7-48db-8294-545782f0edee service nova] Creating event network-changed:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:06:10.968281 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-153ac43f-84fe-49f4-9b1c-82670ed5c3bc req-a0aa5dd6-b2e7-48db-8294-545782f0edee service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028605 May 13 22:06:10.968873 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 521/1047] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 22:06:41.609971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:06:41.610605 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Fri May 13 22:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:08:05.733725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:08:05.734431 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:05.740150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:05.740596 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:05.741349 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:05.741780 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:05.764313 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.objects.instance [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lazy-loading 'flavor' on Instance uuid b29798ad-9308-4d8d-a58f-08ac4c9362d4 {{(pid=128489) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 22:08:05.831750 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-f7cfb763-3690-4ef6-a4e8-262374cf44c9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "POST /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4/action" status: 202 len: 0 microversion: 2.1 time: 0.102865 May 13 22:08:05.832726 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 527/1048] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:08:05 2022] POST /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:08:05.839406 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c70f54bb-52f4-4134-ba10-794beff6d096] AMQP server on 10.222.0.35:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 13 22:08:05.843583 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:05.844449 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:05.851394 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:05.852896 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:05.854302 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:05.854760 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:06.073790 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:06.081079 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-4352302f-0e83-41ee-9b5d-2cf564ee32f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.243819 May 13 22:08:06.081622 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 522/1049] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:05 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:08:07.098848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:07.099567 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:07.106374 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:07.106848 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:07.107606 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:07.108064 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:07.302164 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:07.309971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-143176b8-09c0-42d8-ad9f-48a46c5ecd48 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.215327 May 13 22:08:07.310529 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 528/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:07 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:08.326940 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:08.327534 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:08.334658 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:08.335128 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:08.335912 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:08.336344 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:08.342006 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] [c70f54bb-52f4-4134-ba10-794beff6d096] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 37332. May 13 22:08:08.468823 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:08.476013 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b5a854d4-8c77-4a18-b7ba-9c538f7080c8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.153033 May 13 22:08:08.476574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 523/1051] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:08 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:09.493486 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:09.494094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:09.500977 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:09.501424 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:09.502187 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:09.502620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:09.628566 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:09.636497 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-59ff7126-07cd-452d-8321-22c76a129285 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.146235 May 13 22:08:09.637062 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 529/1052] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:09 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:10.654426 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:10.655067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:10.661370 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:10.661826 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:10.662588 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:10.663058 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:10.790022 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:10.797226 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-3eb03455-17de-455e-b607-5d223cb91eeb tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.147281 May 13 22:08:10.797791 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 524/1053] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:10 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:11.813303 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:11.813889 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:11.820144 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:11.820587 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:11.821342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:11.821774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:11.952847 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:11.960098 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-79145f1c-294d-4e10-a658-0919f3ecaf63 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.150685 May 13 22:08:11.960654 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 530/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:11 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:12.977799 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:12.978657 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:12.984956 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:12.985433 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:12.986197 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:12.986634 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:13.112780 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:13.120489 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-18b17698-f650-4f51-80ac-c71f1af6df91 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.146070 May 13 22:08:13.121057 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 525/1055] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:12 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:14.137422 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:14.138058 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:14.144344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:14.144792 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:14.145549 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:14.145981 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:14.282042 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:14.289467 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-44bfd8b0-21fe-4731-a761-388898211a6b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.156047 May 13 22:08:14.290028 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 531/1056] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:14 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:15.308362 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:15.308970 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:15.315264 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:15.315704 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:15.316457 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:15.316884 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:15.443095 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:15.452459 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-79ca7ab2-c292-425d-98eb-c43bd9ce0e7e tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.148537 May 13 22:08:15.453025 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 526/1057] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:15 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:16.469341 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:16.469967 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:16.476429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:16.476890 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:16.477668 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:16.478378 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:16.651254 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:16.658646 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-aae2023f-bf1d-40e0-8c31-33d94837aab5 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.193126 May 13 22:08:16.659347 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 532/1058] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:16 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:08:17.676169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:17.676775 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:17.683576 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:17.684021 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:17.684772 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:17.685204 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:17.812112 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:17.819345 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-27205df7-7304-4aa5-9587-a3e023aa1e8b tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.147017 May 13 22:08:17.819907 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 527/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:17 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:18.837094 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:18.837729 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:18.844869 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:18.845379 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:18.846224 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:18.846595 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:18.973344 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:18.980882 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c520014c-111f-42db-bbce-e5b54f0d8f7c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1569 microversion: 2.1 time: 0.147807 May 13 22:08:18.981449 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 533/1060] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:18 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:18.996828 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:08:18.997403 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:19.003746 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:19.004200 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:19.004962 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:19.005399 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:19.089670 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [c74103d9-4b01-4778-a67d-a0957cf88ecd] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 22:08:20.095955 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [c74103d9-4b01-4778-a67d-a0957cf88ecd] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 37360. May 13 22:08:20.099552 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-b79f8de7-f1eb-4a22-b875-455a3b1d5826 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "POST /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4/action" status: 202 len: 0 microversion: 2.1 time: 1.106585 May 13 22:08:20.100173 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 528/1061] 10.222.0.35 () {60 vars in 1277 bytes} [Fri May 13 22:08:18 2022] POST /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4/action => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 22:08:20.108395 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:20.109004 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:20.115149 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:20.115600 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:20.116364 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:20.116799 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:20.253315 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:20.261008 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-b438e2e9-47f3-4854-9fa6-401a9bf7b652 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1517 microversion: 2.1 time: 0.156430 May 13 22:08:20.261572 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 534/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:20 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:21.169927 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-8c8a5d15-6846-4bf3-a43b-0ef275423a94 req-26814c15-35f7-45b5-985f-b601c23b273e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "name": "network-vif-unplugged", "status": "completed", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:08:21.181620 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-8c8a5d15-6846-4bf3-a43b-0ef275423a94 req-26814c15-35f7-45b5-985f-b601c23b273e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:21.182067 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-8c8a5d15-6846-4bf3-a43b-0ef275423a94 req-26814c15-35f7-45b5-985f-b601c23b273e service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:21.195410 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.compute.server_external_events [req-8c8a5d15-6846-4bf3-a43b-0ef275423a94 req-26814c15-35f7-45b5-985f-b601c23b273e service nova] Unable to find a host for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4. Dropping event network-vif-unplugged {{(pid=128488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 22:08:21.196313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-8c8a5d15-6846-4bf3-a43b-0ef275423a94 req-26814c15-35f7-45b5-985f-b601c23b273e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031240 May 13 22:08:21.197019 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 529/1063] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 13 22:08:21.277963 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:21.278674 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:21.284976 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:21.285429 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:21.286196 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:21.286638 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:21.417592 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:21.426177 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-02cedea5-0a96-4924-94fa-2dc97f43b49c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1519 microversion: 2.1 time: 0.152565 May 13 22:08:21.427384 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 535/1064] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:21 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:22.444855 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:22.445460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:22.452460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:22.452975 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:22.453724 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:22.454154 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:22.582463 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:22.589752 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-afbd6505-6c82-4f22-afff-bb945978a947 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.148842 May 13 22:08:22.590313 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 530/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:22 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:23.607359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:23.607970 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:23.613915 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:23.614362 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:23.615339 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:23.615599 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:23.743610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:23.751526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-8b9de47a-3f0b-4beb-bc17-42e58beaf1cc tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.148480 May 13 22:08:23.752093 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 536/1066] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:23 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:24.771278 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:24.771921 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:24.778939 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:24.779389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:24.780146 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:24.780582 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:24.911335 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:24.918571 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-64182826-1675-4732-aa38-9c5ace657471 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.151261 May 13 22:08:24.919164 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 531/1067] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:24 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:25.936152 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:25.936797 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:25.943150 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:25.943610 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:25.944386 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:25.944836 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:26.082647 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:26.089959 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-97d32333-e1cc-4da3-9ea2-d91b09e3ec28 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.158216 May 13 22:08:26.090525 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 537/1068] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:25 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:27.107662 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:27.108279 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:27.114617 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:27.115084 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:27.115850 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:27.116292 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:27.246169 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:27.253640 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-6793f29a-d128-4b1e-9ec0-0868004b0a60 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.150653 May 13 22:08:27.254210 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 532/1069] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:27 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:28.270669 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:28.271292 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:28.277672 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:28.278128 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:28.278941 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:28.279387 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:28.407141 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:28.414408 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-6b3e1152-f8c9-48bd-81e1-bbf3394e04e6 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.147618 May 13 22:08:28.415006 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 538/1070] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:28 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:29.431460 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:29.431990 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:29.438250 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:29.438687 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:29.439476 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:29.439911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:29.568078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:29.575923 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-eae7aa9f-d84a-46aa-88f8-4c3ba7b32c25 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.148396 May 13 22:08:29.576482 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 533/1071] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:29 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:30.593324 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:30.593928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:30.600171 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:30.600620 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:30.601373 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:30.601804 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:30.735971 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:30.743159 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-3eaf0501-49b8-4334-be01-fae8350f16f8 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.153633 May 13 22:08:30.743725 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 539/1072] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:30 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:31.383266 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-7baa92e6-17c2-4264-b3cc-56caf80e8ce3 req-9fbdaf5a-dd90-43eb-8147-e8d6da4faacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "name": "network-vif-plugged", "status": "completed", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:08:31.392052 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-7baa92e6-17c2-4264-b3cc-56caf80e8ce3 req-9fbdaf5a-dd90-43eb-8147-e8d6da4faacb service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:31.392520 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-7baa92e6-17c2-4264-b3cc-56caf80e8ce3 req-9fbdaf5a-dd90-43eb-8147-e8d6da4faacb service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:31.403599 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-7baa92e6-17c2-4264-b3cc-56caf80e8ce3 req-9fbdaf5a-dd90-43eb-8147-e8d6da4faacb service nova] Creating event network-vif-plugged:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:08:31.408680 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-7baa92e6-17c2-4264-b3cc-56caf80e8ce3 req-9fbdaf5a-dd90-43eb-8147-e8d6da4faacb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029120 May 13 22:08:31.409213 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 534/1073] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:08:31.760639 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:31.761243 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:31.767428 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:31.767876 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:31.768629 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:31.769060 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:31.906257 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:31.913496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-1765168b-4d32-4c6f-99cf-fc098ac31d3a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1575 microversion: 2.1 time: 0.156671 May 13 22:08:31.914000 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 540/1074] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:31 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:32.931867 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:08:32.932609 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:08:32.938653 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:32.939123 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:32.939911 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:08:32.940346 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:08:33.070176 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:08:33.077891 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-006a7884-f942-4410-994f-3059144e24f9 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1562 microversion: 2.1 time: 0.150609 May 13 22:08:33.078455 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 535/1075] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:08:32 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:08:34.425315 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:08:34.425961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:09:46.870410 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:46.871003 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:09:46.877114 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:46.877570 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:46.878351 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:46.878816 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:46.904904 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Going to try to terminate instance {{(pid=128489) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 22:09:46.939477 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-15a882f2-da06-4b77-91ea-2363209ffe6f req-2957575f-7008-4763-858b-6a08d9c099e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:09:46.950827 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-15a882f2-da06-4b77-91ea-2363209ffe6f req-2957575f-7008-4763-858b-6a08d9c099e5 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:46.951453 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-15a882f2-da06-4b77-91ea-2363209ffe6f req-2957575f-7008-4763-858b-6a08d9c099e5 service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:46.963777 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-15a882f2-da06-4b77-91ea-2363209ffe6f req-2957575f-7008-4763-858b-6a08d9c099e5 service nova] Creating event network-changed:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:09:46.969121 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-15a882f2-da06-4b77-91ea-2363209ffe6f req-2957575f-7008-4763-858b-6a08d9c099e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102301 May 13 22:09:46.969993 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 536/1076] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:09:46.985746 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c5d96d44-1e7c-4172-a188-066a3807f63a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 204 len: 0 microversion: 2.1 time: 0.120440 May 13 22:09:46.986327 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 541/1077] 10.222.0.35 () {58 vars in 1238 bytes} [Fri May 13 22:09:46 2022] DELETE /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 22:09:46.995408 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:46.996105 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:09:47.002025 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:47.002472 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:47.003256 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:47.003687 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:47.139915 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.policy [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128488) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:09:47.147228 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-8808eb4d-92b0-4cbf-99fb-4278da8c873c tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.156498 May 13 22:09:47.147800 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 537/1078] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:09:46 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 22:09:48.165073 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:48.165774 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:09:48.172297 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:48.172751 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:48.173522 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:48.173965 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:48.325156 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:09:48.332471 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-837145e1-44f0-4f45-82c2-01ebbb850e44 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1568 microversion: 2.1 time: 0.171613 May 13 22:09:48.333042 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 542/1079] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:09:48 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:09:49.212379 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [req-af1ef46a-8da1-4417-82b1-0a1151adf159 req-652b85c4-d475-4ae4-b729-a46dc80959df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b29798ad-9308-4d8d-a58f-08ac4c9362d4", "name": "network-vif-deleted", "tag": "e020c9fc-c2b6-4513-93a1-6840e84092a4"}]} {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 22:09:49.220842 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-af1ef46a-8da1-4417-82b1-0a1151adf159 req-652b85c4-d475-4ae4-b729-a46dc80959df service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:49.221283 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [req-af1ef46a-8da1-4417-82b1-0a1151adf159 req-652b85c4-d475-4ae4-b729-a46dc80959df service nova] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:49.233386 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.compute.server_external_events [req-af1ef46a-8da1-4417-82b1-0a1151adf159 req-652b85c4-d475-4ae4-b729-a46dc80959df service nova] Creating event network-vif-deleted:e020c9fc-c2b6-4513-93a1-6840e84092a4 for instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 on hv-cinder-84051 May 13 22:09:49.238544 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [req-af1ef46a-8da1-4417-82b1-0a1151adf159 req-652b85c4-d475-4ae4-b729-a46dc80959df service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030214 May 13 22:09:49.239078 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 538/1080] 10.222.0.35 () {64 vars in 1317 bytes} [Fri May 13 22:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 22:09:49.349319 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:49.349962 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.compute.api [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128489) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:09:49.357014 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:49.357460 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:49.358215 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:49.358645 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG oslo_concurrency.lockutils [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128489) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:49.421496 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.policy [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e4fe6d0ffd4bc7bdf1314b0379e4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c01b24fcbc4cbfa59373f7c804781d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128489) authorize /opt/stack/nova/nova/policy.py:199}} May 13 22:09:49.428928 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-c1a42b6b-4721-4ca9-8d9d-3204c0ae4730 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 200 len: 1220 microversion: 2.1 time: 0.083443 May 13 22:09:49.429432 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 543/1081] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:09:49 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 22:09:50.447051 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '>' {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:50.448097 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.compute.api [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [instance: b29798ad-9308-4d8d-a58f-08ac4c9362d4] Fetching instance by UUID {{(pid=128488) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 22:09:50.454134 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:50.454574 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:50.455374 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 22:09:50.455792 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG oslo_concurrency.lockutils [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Lock "415e9a87-7af9-4b21-ab24-8ddfa7580a0e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 22:09:50.468469 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.wsgi [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] HTTP exception thrown: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Request method failure captured: May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: request: GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 HTTP/1.1 May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept: application/json May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Accept-Encoding: identity May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Connection: close May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Length: 0 May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Content-Type: application/json May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Host: 10.222.0.35 May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Openstack-System-Scope: None May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: User-Agent: python-urllib3/1.26.9 May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Auth-Token: gAAAAABiftYqjuo_m1wnL1R0FEhWjSBJ36SKde1geoujIccHvFeJOWt548TTxwx0Aro-EcXTsn-HbjbiMeZUqfrbwE3HQ2msB2z5yRwQhFTe8zRIT8YhLTMNctRXcX6qhFRUjpaOagWDJX4z2nLhHuT7xOznz6WCv4RFXMYkTayk6a4sZcmGiKc May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Id: None May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Domain-Name: None May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Identity-Status: Confirmed May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Is-Admin-Project: True May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Id: default May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Domain-Name: Default May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Id: e1c01b24fcbc4cbfa59373f7c804781d May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Project-Name: tempest-TestShelveInstance-855526089 May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Role: member,reader May 13 22:09:50.470061 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Roles: member,reader May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1c01b24fcbc4cbfa59373f7c804781d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/e1c01b24fcbc4cbfa59373f7c804781d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_e1c01b24fcbc4cbfa59373f7c804781d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/e1c01b24fcbc4cbfa59373f7c804781d"}]}] May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant: tempest-TestShelveInstance-855526089 May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Id: e1c01b24fcbc4cbfa59373f7c804781d May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-Tenant-Name: tempest-TestShelveInstance-855526089 May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User: tempest-TestShelveInstance-855526089-project May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Id: default May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Domain-Name: Default May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Id: b1e4fe6d0ffd4bc7bdf1314b0379e4cc May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: X-User-Name: tempest-TestShelveInstance-855526089-project May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: method: > May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: exception: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. May 13 22:09:50.471961 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: action_args: {'id': 'b29798ad-9308-4d8d-a58f-08ac4c9362d4'} May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: {{(pid=128488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 22:09:50.472980 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. May 13 22:09:50.474600 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: ERROR nova.api.openstack.wsgi May 13 22:09:50.476062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: DEBUG nova.api.openstack.wsgi [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Returning 404 to user: Instance b29798ad-9308-4d8d-a58f-08ac4c9362d4 could not be found. {{(pid=128488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 22:09:50.476062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO nova.api.openstack.requestlog [None req-1b3abb32-33ba-436f-8357-1e690027c50a tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4" status: 404 len: 111 microversion: 2.1 time: 0.029596 May 13 22:09:50.476062 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: [pid: 128488|app: 0|req: 539/1082] 10.222.0.35 () {58 vars in 1235 bytes} [Fri May 13 22:09:50 2022] GET /compute/v2.1/servers/b29798ad-9308-4d8d-a58f-08ac4c9362d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 22:09:50.626342 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: DEBUG nova.api.openstack.wsgi [None req-2f649f26-bf71-43cd-a56c-940ce9b63490 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] Calling method '.version_select at 0x7fb7dff2e310>' {{(pid=128489) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 22:09:50.629577 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f649f26-bf71-43cd-a56c-940ce9b63490 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [0742f434-b8db-42d9-9dd8-7e08e373f2f3] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 22:09:51.637048 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f649f26-bf71-43cd-a56c-940ce9b63490 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] [0742f434-b8db-42d9-9dd8-7e08e373f2f3] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 37454. May 13 22:09:51.654783 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO nova.api.openstack.requestlog [None req-2f649f26-bf71-43cd-a56c-940ce9b63490 tempest-TestShelveInstance-855526089 tempest-TestShelveInstance-855526089-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1499381974" status: 202 len: 0 microversion: 2.1 time: 1.032224 May 13 22:09:51.655359 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: [pid: 128489|app: 0|req: 544/1083] 10.222.0.35 () {58 vars in 1253 bytes} [Fri May 13 22:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1499381974 => generated 0 bytes in 1033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 22:10:01.618153 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:10:01.618899 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Fri May 13 22:10:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:11:53.341064 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:11:53.341753 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:11:54.433325 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:11:54.434549 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:11:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:12:09.658847 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:12:09.659434 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Fri May 13 22:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:13:21.627526 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:13:21.628220 dv-cinder-840516-1-iscsi devstack@n-api.service[128489]: Fri May 13 22:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:13:38.995998 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:13:38.996594 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:15:13.349389 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:15:13.350059 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 22:15:14.441982 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 22:15:14.442757 dv-cinder-840516-1-iscsi devstack@n-api.service[128488]: Fri May 13 22:15:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!